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GETTING ACQUAINTED 



The Intermediate Form of the Educational Quality Assessment Inventory (EQAI) for 
grade 8 is an assessment device designed to give Commonwealth educators meaningful, reliable, 
and accurate information about their students' development in each of the 10 state adopted quality 
education goals. The EQAI can be characterized as a collection of highly structured, 
pape^and-pencil me^urement scal^. These scales repre^nt an attempt to appraise mious npects 
of cognitive and human interaction skills together with those attitudes, values, and beliefs thought 
important in helping our young people adjust to the demands of today's society and tomorrow's 
worid. 

Is this a complex task? Yes. Can it be done in such a way as to provide reasonably 
accurate information? We believe so. However, big words and fancy phrases don't get tbt job 
done. 

To insure that the scales included in the EQAI could provide relevant information, 
the Department of Education maintained the stance of tesUog the tests befoiv using them to 
test people. After completing the tasks of operationally defining each goal area and developing 
measurement rationales consistent with these definitions, the department went to the field. 

During a five-year period ( 1969-1 974) approxim ttely 45 separate instnunents containing 
over 2,(X)0 items were constructed, revised, rejected or accepte^i on the basis of countless i^ot-tests 
in over !7S Pennsylvania school districts. 

This booklet describes in detail th(ise scales that survived the logical and statistical checks 
and remain in the final form of the EQAI. Aspects of the descriptions are necessarily statistic 
and are couched in the language of the test and measurement field. Because the information 
contamed in the publication is equally relevant to school personnel and research scientists, we 
have made a concerted effort to Include explanations of the logic behind the various analytical 
methods used to determine the adequacy and the efficiency of the tests. 
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QUESTIONS AND ANSWERS 



ABOUT EQA INVENTORY 

Who takes the test bauery? 

The Intennediate Form of the EQA Inventory is designed spedflcaliy for 8th grade 
students in Commonwealth public schools who have a reading comprehension equal to or greater 
than the avera^ Sth grader. Research indicates that the tests are adequate for students with 
less reading skill (to grade 3.S) if the tests are read to them. The tests are not recommended 
for special education students. 

How long is the inventory? 

Eleven separate tests containing a total of 422 items make up the bulk of the battery. 
Twelve additional questions obtain student back^und information hicluding occupation of fatlwr 
or legal guardian, education of mother, sex, size and type of community, stability of residence, 
etc. Finally 13 questions measure student perception of parental attitude toward tl^ school 
and home climate. The total battery is typically completed in four sessions of one hour each. 

What kindi of tests are in the inventory? 

Three multiple-choice instruments tap cognitive skill, achievement and awareness in the 
areas of verbal analogies, mathematics and vocations respectively. The math and verbal tests are 
timed. The remaining eight are self-report attitude and interest scales asking students to respond 
to statements on various continuums such as agree-disagrce, true of me-not true of me, yes-no, 
etc. 

What do the tests cover? 

Each scale is designed to measure some facet of one state quality education goal. Along 
with basic skills the various instruments examine 1) social and health habits, 2) feelings toward 
self and others, 3) value placed on learning and human accomplishments, 4) interest in creative 
activities and 5) methods of coping with frustration. 

Do the tests completely cover each goal? 

No. The goals are very broad statements organizing many related concepts under one 
umbrella. An inventory of S,(KX) items probably could not measure the goals in their entirety. 
Strong efforts have been made to sample some of the most salient fa^ts of each goal. Section 
One in this book describes in detail which ^pects of the goals are measured. 

What types of scoring procedures are us^ 

For the achievement tests simply the number of correct answers is cotmted. The attitude 
scales are scored in two ways. First, each set of response options is ghren a weighting consistent 
with its corresponding Item s direction (i.e. 1 like sdiool; strongly agree » 3, agree » 2, disagree 
~ 1, and strongly disagree » 0). Item scores are then summed to form a composite score. This 
is called norm-^ferenc^d scoring. The second procedure classifies options into categories of 
favorable and nonfavorable. In the above example the strongly agree and f^ee choices are given 
a score of one while disagree and strongly disagree are given a score of zero. Students choosing 
favorable responses on a simple majority of scale items meet the criterion of minimum positive 
attitude. This technique is called criterion-referenced scoring. 



Can the tests be used to pinpoint specific student-body strei^ths and wnkncsses? 

Yes. With the exception of the basic skills instruments, all questionnaires are broicen 
into smaller components called subscales. The inventory's 26 sub«;al^ givs mote specific 
information than can be provided by the composite scores alone. For example, the Goal 
V-<'itizenship Instrument-offere additional scores in the areas of 1) ccmcem for the welfare and 
dignity of others, 2) respect for law and authority and 3) personal responsibility and integrity. 
Section One contains descriptions of all subscales. 

Are the teste reliable? 

Extensive investigation concerning the consistency v. student responses within each scale 
(internal consistency) and the stability of student responses to the scales over time (test-retest 
reliability) have been conducted by Division of Educational Quality Assessment perscmnel. All 
total scales demonstrate high internal consistency reliability and adequate stability. Some of the 
shorter subscales, however, demonstrate weak internal consistency reliability. Reliability statistics 
for all subscales and total instruments are presented in Section Two. 

Do students fake their answers? 

All self-report questionnaires are susceptible to this sort of response bias. During field 
trials correlations were computed between test scores and a special instrument called the socid 
desirability scale which is designed to pick up the tendency to make oneself look good. Where 
largu coirelations were found, the tests were revised or dropped. Correlations between tie and 
total instrument scores are presented in Section Two. 

Are the tests vaHd? 

Correspondence between ratinp made by teachers and the student scores i:9s been 
demonstrated for six of the attitude scales. Results for a group of studies conducted by the 
Division of Research coupled with outcomes form a factor-analysis lend further validity support. 
Findings relating to test validity are presented in Section Three. 

How much does testing climate affect final outcomes on the tests? 

.\ 1971 study involving 91 schools showed that the emotional climate (student eagerness, 
concentration and carefulne^) became poorer as the testing ^ssion projpessed. Correlations 
between emotional climate and instrument scores, although slightly positive, were not statistically 
significant. Also schools experiencing adverse testing conditions in terms of settings, distractions, 
etc. were not found to score lower than schools with no testing distractions on any of the scales. 

Are individual student profiles provided? 

No. The unit of analysis of all data received from the Educational Quality Assessment 
Program is the school. No Individual student profiles are given. In fact, student names are removed 
from the answer booklets before being scored as a means of insuring confidentiality of student 
answers. 

Do the tests identify target groups for program focus? 

Yes. Even though individual records are unavailable, it is possible to organize dati to 
help identify general student groups having difficulty in a goal area. This is done by summarizing 
data for various subgroups of students formed from selected student characteristics. The three 
student characteristics in these analyses are ability level, sex and father's occupation. Section 
Four shows the proportion of students in each of 18 subgroups who demonstrate positive attitudes 
on all goal instruments except basic skills and vocational awareness. 



1$ the EQA Inventory the only source of information for the Edii»itional Quality AsKnm«it 
Program? 

No. In addition to the student qu^tionnaires, there is a survey for teachers and another 
for school administrators. The results of these surveys are combined to generate a report for 
each participating school. For a complete description of the contents of the^ surveys refer to 
Manual for Interpreting School Reports. 

What kinds of information does the inventory (Hrovide? 

Information includes 1) student-body standing on each composite goal test relative to 
a statewide reference group, 2) student-body standing relative to groups similar hi home and 
school environments, and 3) proportion of student-body who demonstrate mhiimum positive 
attitudes. 

Are teacheis held accountable for poor test scores? 

No. The Educational Quality Assessment Program uses three ^pamte assessment 
inventories to examine student goal achievement at grades 5, 8 and 11. Students at other grade 
levels do not take the tests. Test outcomes are not sobiy a result of what teachers at those 
three levels are or are not doing. Student attitudes and achievements are a complex product 
of the total home, school and community experien^. Accountability only comes into play in 
terms of taking quality assessment results into consideration when trying to meet the needs of 
students. 

Does the Department of Education offer any he^ hi Mentifybig and fanplementing currietilar 
stiateg^ that m^t faioease student goal achievemoit? 

Curriculum specialists are investigating new curricular approaches and related literature 
in the hope of offering interested Pennsylvania schools help to meet student goal needs. As these 
materials become finalized they are being made available to school districts. 

Is there any fatdlcation that schools can hnprove student attitudes by fanplemaitfaig progtanM? 

Yes. Several programs developed by school districts have already yielded measurable 
improvements on the EQA Inventory scales. The most recent example invohres a large district 
in western PennsyWania that under an ESEA Title III grant implemented curricular dianges which 
resulted in an increase in their student-body's hiterest in leamfatg. Specific hiformation about 
this project is available at the offices of the Division of Educational Quality Assessment upon 
request. 

What information Is contained hi tfUs booklet? 

Section One discusses the 10 quality education goals and the measurement devices 
associated with each. Included in thi'i section are goal and measurement rationales, scale and 
subbcale descriptions, and spedflcations for scoring. Section Two describe the safeguards used 
to produce tests of high quaUty and describes how the BQAI tests fare on these checks. The 
third section surveys the results of validity studies Uiduding teacher ratings, factor analysis and 
independently conducted studies. Section Four identifies potential student target groups for 
program focus. 



Are theie any addittoiid ttatistfeal suinroarin the tnts 

Yes. This booklet highlights (mly the m^or empiiical data that an available on the 
EQA Inventory. Additional materials include item fivquency distribatiom» per oent favombie 
responses to each item, item-to-total correlation$» a complete factor ana^^ with orthogonal 
rotations of 2 through 10 factois and various other descriptive statistics including ikewnea, 
kurtosis, means, standard deviations and standard errors of meaauement for eadi sub and total 
scale. These are in computerprintout form and may be ^n at the offices of the Division of 
Educational Quality Assessment in Harrisburg. 
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GOAL i Self-Esteem 

Quality eduodon diould hdp every child acquire the gieatest possible uitderstandiiig of himself 
or heiiself and appreciation of his or her worthiness as a member of society. 



GOAL RATIONALE 

It is widely held that self-understanding is significantly associated with personal 
satisfaction and effective functioning. How students view their adequacies and inadequacies, their 
values and desires, can strongly influence their performance in school. 

No matter what the level and pattern of students' talents, the school experience should 
strengthen, not damage, their self-esteem. School should operate so that children of all talent 
levels can appreciate their worth as persons in a society that claims to be equally concerned 
for all its members. 

MEASUREMENT RATIONALE 

Self-esteem is a personal judgment of worthiness. It is a subjective experience which 
the individual conveys to others verbally or by other behavior. Most theories acknowledge that 
our self-image and feelings of worthiness are determined largely by how well we can Uve up 
to our own aspirations and meet expectations of others. 

Aspirations become closely a^ociated with personal goal-setting behavior originating in 
our internalized system of values. Expectations are external in nature and are related to go^ 
set collectively by society or by significant individuals in our lives. Assessment in this area is 
based on four components believed to be related to the ctevelopment of positive self-esteem. 

The first has to do with locus of control— whether one views personal success as 
dependent upon one's own efforts or external influences. Externally controlled individuals will 
tend to be more dependent on others and more willing to ride with the tide, accepting docilely 
things which happen to them. Internal individuals will more actively attempt to control self-destiny. 

The second related concept is self-confidence — the feeling of self-worth and the belief 
that one is capable of handling things successfully. Tliose who lack self-confidence are often 
characterized as being tinud, cautious, submissive individuals who feel inadequate, fearful, inferior 
and expect to be unsuc(^ssful in dealing with new situations. 

The third component is ima^ in school settings. Those having favorable self4mages 
are likely to experience subjective success with schoolwork, feel that they are favorably viewed 
and understood by teachers and enjoy class participation. 
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The flnal dimension consident how students feel about the quality of their lelationships 
with others. Individuals who have difficulty in interpersonal relations will tend to betieve that 
others have little confidence in or low regard for them. 



GENERAL SCALE DESCRIPTION* 



The self-esteem scale is comi»:i»d of 40 short, self'description statements. Twenty-<»ie 
aie positively worded --describing the student in a favorable light and 19 are negatively worded 
—characterizing the student in a neptive vein. 

Sample positively worded item: /'m my to get along with. 

Sample negatively worded item: Things are all mixed up in my life. 
Response options available to the students are ( 1) very true of me, (2) mostly true of me, (3) 
mostly r.itnte of me and (4) very untrue of me. 

The items withhi the scale are grouped to yield four subscate scores in addition to 
a total scale score. 



Subscale 1: Seffi-confldenc*- contains 10 items measuring feelings of success, self-detMmlnation, 
attractiveness and self-worth. Sample item: I'm pretty aire of myself. 

Subscale 2: Feelings of control over environment contains 10 items tapping belief that success 
hi school and work depend on effort, not luck. Sample item: My getting good 
grades in school depends more on how the teacher feels about me than on how 
well I can do my work. 

Subscale 3: Relationships with others contains 10 items as^dng tiie student's perceived ease 
fa) making and keeping firiends and the student's feelings of acceptance by others. 
Sample item: / often feel picked on by other kids. 

Subscale 4: Self-image in school comprises 10 items designed to measure feelings of success 
in school work, class recitation and teacher relaticmships. Sample item: In class, 
I often feel 'put down' by teachers. 

NORM-REFERENCED SCORING 

For norm-referenced scoring the item weighting scheme used is: 

Response Choices 



Item 

Direction 



Very True 
of Me 



Mostly True 
of Me 



Mostly Untrue Very Untrue 
of Me of Me 



Positive 
Negative 



3 
0 



2 
1 



t 

2 



0 
3 



seiiSVecm scale is a result of extensive revision of the Goal I instrument whidi was used 
for grades 5 and 11% Richard L. Kohr and Nolan F. Russell from the Div^on of Educational 
Quality Assessment were responsible for the revisions. 
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CRITERION-REFERENCED ^RING 



Responses are considered fawrable if tliey reflect a positive selt-L-nage. An individual's 
score on a given scale (total or subscale) is the percentage of items to v^ch a favorable response 
was given. For the self'«steem instrument the scoring scheme applied to the items is: 

Response Chdces 

/fern Very True Mostly True Mostly Untrue Very Untrue 

Direction of Me of Me of Me of Me 

Positive 110 0 

Negative 0 0 1 i 
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GOALiI Tcrierance Toward Others 

Quality education should htip every chUd acquire undeistaiKfiiig and i^pieeiation of posons 
belonjuig to other social^ cuitoial and ethnic groups. 



GOAL RATIONALE 

Students fulfilling the requirements of Goal 11 win more likely enjoy easy interaction 
with all people— speaking to and setecting as friends students of different origins and belief. 
They will be more wilUng to actively seek information or participation in activities which wiU 
increase their knowledge about different cultures and social setthigs. 

The school experiences should help students learn to respect and interact easily with 
children who differ from them hi various aspects (e.g.« skin color, cultural traditions, economic 
status, religious beliefs, physical abilities, manner of speech and degree of intellectual competence). 

MEASUREMENT RATIONALE 

The processes and determinants of interpersonal interaction are comi^x, hivohring a 
myriad of perceptual, fi^Ung and behavior responses. 

The noticm of tolerance toward others has meant (Afferent thhigs to various theorists. 
Some define tolerance Ui terms of the social distance individuals keep between themselves and 
differing others. Others use tolerance to describe the tendency of hidlviduals to prejudge or act 
toward differing others solely on the basis of the differing others' group membership. 

The assessment of thk goal area is based on stUl another component of tolerance. This 
component is the degree of comfort felt by individuals when hi contact with differing others. 

GENERAL SCALE DESCRIPnON* 

Items describe dtuatifms where differing others hiteract with the individual. Differences 
are hi terms of racial, religious and sodal background or physical and mental attributes. 
Twenty>nine items suggest ah approach toward the student, e.g., A cripple wants 
you to become a close friend. Six items suggest an avoidance of the student, e.g., A girl with 
a bad limp avoids you because she thinks you might make fitn of her. Response choices are 
1 would feel (1) very comfortable, (2) comfortable, (3) slightly uncomfortable and (4) very 
uncomfortable. 



*The tolerance toward others hutrument was developed by Eugene W. SkifSngton and Nolan F. 
Russell from the Division of Educational Quality Assessment and Peggy L Stank and Tom 
McGhinis from the Division of Research. 
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The items within tile scale are grouped to yield five subscate scores in addition to a 
total scale score. Assignment to subscales is based upon the characteristic of tht hypothetical 
target person that makes that person different from tiie respondent The five ntbscales ate race, 
religion, socioeconomic sUtus, intelligence and handicap. All subscales contain seven items. 

NORM-REFERENCED SCX>R1NG 

For norm-referenced scoring, the item weighting scheme is: 

Response Options 

Item Very Slightly Very 

Direction Comfortable Comfortable Uncomfortable Uncomfortable 

Positive 3 2 10 

Negative 0 I 2 3 

CRTTERION-REFERENCED SCORING 

Responses are considered favorable if they reflect comfort when interacting with^differing 
otiiers or discomfort when being shunned by differing otiiers. An individual's scoie^on a gben 
scale (total or subscale) is the percental of items to which a favorable response was given. For 
the tolerance toward others instrument the scoring scheme for items is: 

Response Options 

Item Very ^^tly Very 

Direction Comfortable Comfortable Uncomfortable Uncomfortable 

Positive < 1 0 0 

Negative 0 0 1 l 
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GOAL III Basic Skills 

Quality edncatioa should help every child acquire, to the tvUkst pos^Uile «(tait« niMtery of 
the basic sidBs in the use of words and numbm. 



GOAL RATIONALE 

Mastery of the basic skills in the use of words and numbers is fundamental to 
achievement in all academic areas. Basic skills include the ability to get ideas through reading 
and listening, to handle mathematical operations* to reason logically and to respect evidence. 
The level of performance that can be reasonably expected hi each of th^ areas will my ftom 
school to school. However, it is of profound importance that the level of expectation in basic 
skills for any group of pupils shaU not be underestimated or regarded ss fixed. 

MEASUREMENT RATIONALE 

In 1969 when Pennsylvania's Educational Quality Assessment Program centered on Sth 
and llth grade students, schools could select either of two standardized achievement batteries 
for measurement in this goal area. It quickly became apparent that the use of diese tests increased 
the length of the testing time so as to cause great difficulty hi scheduling and complethig the 
entire questionnaire. 

Therefore, the use of achievement batteries was discontinued and shorter verbal and 
math scales developed by Educational Testing Service which were group reliable were substituted. 

In the verbal area assessment was directed at the ability to abstract or generalize and 
to think constructively, rather than at simple fluency or vocabulary recognition. The item type 
thought most appropriate was one using verbal analogies. 

The test in the math area is directed at those mathematics skills and concepts all students 
should be familiar with and not skills and concept attahtable cmly by academically gifted persons. 

GENERAL SCALE DESCRIPTION (VERBAL)* 

The verbal scale contahis 30 verbal analogies presented in a multiple<hoice format 
Eadi scale is timed (IS minutes). The scales are scored by giving one point for each correct 
answer. No adjustment is made for guessing. 



•Copyrigiit (c) 1973 Educational Testing Service 



Sample item: (Gmle 8) 



MEAL: BANQUET:: 
A diamond: jewel 
• B car: limoutliie 
C dtesign: oi&aoient 
D lihen fdd 



GENERAL SCALE DESCRIFmN (MATH)** 

The mathematics scale has 30 items and b timed (15 minutes). Its aUUty to identify 
specific strengths and weaknesses in math-felated areas is limited. However, it is considered a 
good meanue for the general level of math achievement on a group Uak. Modem math concepts 
(set notitm, modular arithmetic, istc.) and advanced concepts «ich as tri g ono m etry, logic and 
geometric proofe are not included. Areas tapped are arithmetic CMiputatikm, algebraic and 
geometric concepts and measuremrat A muttiple-^oioe format is used. Earh item requiies students 
to make a size comparison between two quantiti^ The scale is scored by givfaig one potot for 
each correct answer. No adjustment is made for guessing. 

Samide item: (Gnde 8) 



A. The part in Column A is greater. 

B. The part in Cohimn B is greater. 
*C. The two parts are equal. 

D. Not enough information is given to decide. 



••Copyright (c) 1973 Educational Testing Service. 
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GOAL IV Interest in School and Learning 

QuaUty educaticw akould help every (Md acquire a positive attitude tomud tiie learning process. 



GOAL RATIONALE 

The school represents perhaps the most powerful sin^e force in determining a person's 
overall attitude toward learning The climate and learning atmosphere hi the school, the educational 
experiences the school p-o id/.*s and the quality of the personal interactions it fosters between 
student and educator all shape the students' life-long attitudes toward learning. 

The school experience should be such that students find the learning activities associated 
with it enjoyable and rewarding to the point that they are motivated to do well and to continue 
learning on &eir own initiative beyond the requirements of formal education. Everything possible 
should be done to ensure that the attitude of the teacher, the atmosphere of the school, and 
the school's physical condition contribute toward this end so that the individual-both as a child 
and later as an adult-will hold education high among his or her values. 

MEASUREMENT RATIONALE 

In assessing student feelings about education, it is necessary to examine more than just 
those feelings within the context of the students' present school experience. We must also 
determine how this experience is influencing the students' general fUture attitudes toward learning 
beyond the formal educational setting. The measurement device developed in support of this 
goal attempts to sample student attitudes in two areas: The first relates specifically to the present 
school experience while the second focuses learning as a Ufethne process. 

GENERAL SCALE DESCRIPTION* 

In this scale there are 30 statements about the school, teachers, course content and 
the learning experience. Fifteen items cast these areas In a favorable light, e.g., Most of my subfects 
this year are worthwile. The remaining items are negatively stated, e.g.. Teachers don't know 
what they are talking about. Response options available to the student are ( 1) strongly agree, 
(2) agree, (3) uncertain, (4) disagree and (5) strongly disagree. 



*the interest in school and learning scale is a result of extensive revisions of the Goal IV instru- 
ment which was used for grades 5 and 11. George E. Brehman from the Division of Research 
and Nolan F, Russell from the Division of Educational Quality Asses»nent were responsible for 
the revisions. 
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The items within the scale are grouped into two subscales each having IS items. 
&ibscale 1: 

Attitude toward learning measures the student's willingness to expend effort to team 
and to appreciate the value of continued learning throu^out life. Sample item: It 
is very important to me to learn as much as I possibfy can, 

Subscale 2: 

Attitude toward school investigates the degree to which the student believes school 
attendance is important and the student's attitude toward the sdiool setting, teachers 
and course worlc Sample item: Most of my classes this year are boring. 

NORM-REFERENCED SCORING 

For nomwefexenced scoring, the following weighting scheme is used: 



Response Options 

Item Strongly Strongly 
Direction Agree Agree Uncertain Disagree Disagree 

Positive 4 3 2 1 0 

Negative 0 1 2 3 4 



CRITERION-REFERENCED SCORING 

Responses are considered favorable if they reflect student agreement with positive 
statements about school and learning or disagreement with negative statements concerning school 
and learning. A student's score on a given scale (total or subscale) is tiie percentage of items 
to which a favorable response was given. For this scale the scoring scheme ^plied to the items 
is: 

Response Options 

Item Strongly Strongly 
Direction Agree Agree Uncertain Disagree Disagree 

Positive I I 0 0 0 

Ne^tive 0 0 0 1 1 
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BEST con AVAUABIE 




GOALV Citizenship 



Quality education ^uld he^ every child acquire the habits and attitudes associated with 
responsible citizenship. 



GOAL RATIONALE 

Responsible dtizenship embodies a much more complex concept than commonly 
expressed in love of country and participation in the democratic process^ Viewed in its broadest 
sense responsible citizenship implies a respect for law and proper authority, a wilUngness to asstune 
responsibility for our own actions an.i for those of the groups to which we belong, respect for 
the righte of others and overall personal integrity. 

Schools should encourage pupils to ^ume responsibility for their actions as well as 
the actions of the group. Opportunities should be provided for pupils to cooperate and work 
toward group goals and to demonstrate integrity in dealing with others. Pupils should be given 
the chance to take the initiative and assume leadership for group action as well as tend support 
to group efforts as followers. 

MEA$UREME^n^ RATIONALE 

The mores, codes, laws and social expectations of society provide the reference points 
for judging which behaviors reflect responsible citizenship and which indicate poor citizenship. 
A review of literature revealed that the National Assessment of Educational Progress (teveloped 
nine general citizenship objectives. The criterion for inclusion of any one obtjective was its relative 
Importance to society as agreed upon by a conmiitt^ of scholars and lay peopte. 

These national objectives were used to provide the frame of reference for M^t was 
to be measured. Objectives in the factual domain such as (a) knowing structure of government 
and (b) understanding problems of international relations were not considered in develophig the 
scale. 

Arriving at a satisfactory definition of citizenship was much less complicated than 
applying tite definition to tiie assessment of students' attitudes and behaviors. The display of 
responsible citizenship behaviors like honesty or integrity are most often situational. 

A student's display of good citizenship behavior under one set of motivating conditicms 
tells us little about the way he or she can be expected to behave if those conditicnis are altered. 
The context in which the behavior is elicited therefore becomes at teast as hnportant in determining 
the outcome as the predisposition of the individual involved. 
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To assess citizenship, a behavior* referenced model incorporating elements related to 
the psychological notion of threshold is used. In reference to citizenship, threshold refers to tiiat 
set of conditions necessary to bring about the desirable responses. Thus by varying tite situation 
and introducing conditions of reward and punishment we are able to determine the cutoff levels 
at which the student will display positive behavior. In this way it is possilde to ass^ not only 
the students' predisposition to behave in a manner consistent with responsible citizenship but 
also to provide some measure of the intensity of that predisposition across a wide spectrum of 
situations. 

GENERAL SCALE DESCRIPTION* 

Fifty-four items measure willingness to exhibit good citizenship in many social situations 
under a variety of motivating conditions. Social contexts are given by 18 stories, each posing 
a problem and suggesting an action predefined as good or poor citizenship. Each story has three 
items which list positive or negative consequences resulting from the action. Students are asked 
to decide whether to take the acticm for each consequence. 



Sample Story (grade 8): Morton has broken a school window but did not mean to. If I were 

Morton, I would TELL THE PRINCIPAL OR TEACHER about my 
breaking the window when I knew. . . 

Sample item set: Yes Maybe No 

1. The principal would make me Y M N 
stay after school. 

2. My parents would have to pay Y M N 
for the window. 

3. I would have to pay for the Y M N 
window. 

The items within the scale are grouped in such a way as to yield three subscale ^res 
hi addition to a total score. 

Subscale 1: Concern for the welfare and dignity of others contains 15 items (item sets from 
five stories) designed to measure concern for the feelings of others, willingness 
to protest uniust treatment of others, and the tendency to accept new people 
into a group. Also measured is the degree of restraint from teasing or degrading 
othere. 

Subscale 2: Respect for law and authority has 21 items measuring the willingness to report 
iaw-breaking of others, obey authorities during emergencies and prevent classroom 
disruptions. Also a^ssed is the degree of restraint from violent actions that could 
harm others or damage property. 

Subscale 3: Personal responsibility and integrity has 1 8 items which tap the wiUini^Aess to honor 



*Nolan P. Russell from the Dhision of Educational QuaUty Assessment is the author of the 
citizenship scale. 
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self-made commitinentB to buUviduab or groupi and tlie wUUngnett to ttke 
responsiHUty for one's own mistakes and to report mbtakes made in one's favor. 

NORM-REFERENCED I^RING 

The following item weighting scheme it used tet norm-feferenoed scoring: 

Rflspome Options 

Behavtor Direction Yes Maybe No 

Positive Gtizenship 2 I 0 

Negative Citizenship 0 t 2 

CRITERION-REFERENCED SCORING 

R^ponses are considered favorable when ttey reflect a wiHingnen to diqday proper 
citizenship behaviors or an unwillingness to use poor citizenship behaviors. A student's score on 
a given scale (total or subscale) is the percentage of items to wfaidi a twtoxsMn responae was 
given. For the dtizenship scale the scoring scheme applted to the items ia: 



Behavtor Direction 
Positive Gtizenship 
Negative Citizenship 



Req;)onse Options 
yies Maybe No 
1 0 0 

0 0 1 
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BEST con AVAIUBLE 





GOAL VI Health Habits 

Quality educttton ^ould help every diSd acfiuire good l^alth habits and an uidnttandiiig of 
the conditions necessary for maintaining of physical and emotional wdl-teing. 



GOAL RATIONALE 



In their own interest, as well as in the interest of society at large, childien should 
know how to take care of themseWes and how to keep physically fit. They should know what 
the requirements are for phy^cal and mental health and what practices, harmAd to health* should 
be avoided. After gaining this knowledge they should acquire habits which faicrease the probability 
of remaining healthy and fit throughout Ufe. 

In cases where the home has been deficient in encouraging the child to practice sound 
health habits, the schcol has an obligation to be aware of the situation and to see that opportunities 
to remedy the deficiency are provided. 

MEAisUREMENT RATIONALE 

Understanding how diseases and their prevention, dental care» nutrition, personal hygiene, 
safety and drug use relate to the structure and fiinction of the human body is an important 
fiist step in each hidividual's willingness to consistently exhibit habits which are conducive to 
the maintenance of personal health and well-being One does not need to be a doctor to display 
good health practices or a lawyer to dhplay good citizen behaviors. 

Therefore, assessment in this ssmH area attempts to get at students' willingness to display 
proper health behaviors in a variety of situations. 

GENERAL SCALE DESCRIPTION* 

The scaling technique in this inventory is similar to the psychophysical method of Uroits. 
This method holds the behavior constant while systematically allowing the stimuli to vary. The 
strength of the. stimulus (in physical units) which is required to cause a change in the behavior 
is used to define the threshold of that behavior. 

In the casw of this health behavior inventory, the student is asked to decide whether 
he or she would take a given health-related action. Each action is predefined as indicating either 
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*The health habits scale was developed jointly by Nolan F. Russell and Eugene W. Skiffington 
from the Division of Educational Quality Assessment and Mary L. Lydon from the Div^on of 
Research. 
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good or poor health practice. Stimulus contexts surrounding the choices are systematically varied. 
The health-behavinr threshold is defined in terms of the severity of the stimulus contexts tderated 
before changing from good to poor health behavior. More specifically performance is used to 
infer health -behavior threshold by u^entifying the supportive contingencies in the environment 
necessary to maintain good health practices. 

The format of each question is a situational story about a make-believe junior hi^ 
student. The respondent is first asked to consider taking a specific action. In each question three 
motivation-including conditions, i.e., rewards and punishments, are made contingent upon the 
taking of the action. 



Sample story: 



When Norma had the flu the doctor gave her some medicine. The medicine 
also took away the stomach ache Norma had. After she got over the flu, 
Norma had another stomach ache. If I were Norma, I would TAKE THE 
MEDICINE AGAIN when I thought . . 



Yes 


Maybe 


No 


Y 


M 


N 


Y 


M 


N 


Y 


M 


N 



Sample item set: 

1. The medicine tasted good. 

2. It might cure my stomach ache quickly. 

3. My parents might noi want me to take it. 

The items within Uic scale were grouped to yield three subscale scores in additicm to 
a total scale score. 

Subscale 1 : Personal and lommunity health contains 21 items (^ven health situaticms). Content 
includes willingness to follow proper diet, to take; proper medical precautions, to 
use ^>od personal hygiene practices and to refra>n from interpersonal contacts when 
iU. 

Subscale 2: Personal and community safety contains 18 items from six health situations. 

Measured is the degree of restraint from unnecessary risk-taking at home, at school 
and at play and restraint from submitting others to undue risks. 

Subscale 3: Drt^ contain five situations with IS questions to measure restraint from (1) 
improper use of prescription drugs, (2) experimentation with drugs and (3) 
maintaining dose contact with others who are using drugs. Improper use of 
pr^cription drugs includes restraint from using old medicine, medication prescribed 
for others, or more medicine than has been prescribed by the doctor. 

NORM-REFERENCED SCORING 

For norm-reference scores, the following item weighting scheme is used: 



Response Options 
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Behavior Direction 
Positive Health Behavior 
Negative Health Behavior 



Yes Maybe No 
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CIUTERI0N41EFERENCED SCORING 



Re^nses are c<msideiecl fitvorabk when they itfkct a wUUngness to take good 
health-related actions or an unwillingness to display behaviofs that might be harmfUI to health. 
A student's score on a given scale (total or subscale) is the percental of items to which a favorable 
response was given. For the health scale the scoring scheme applied to the items is: 



Behavior Direction 
Good Health Practioe 
Poor Health Practioe 



Response Options 
Yes Maybe No 

1 0 0 

0 0 1 
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GOALVIi Creative Activities 

Quality education should give eveiy child oppottunity and encoufagement to be creatfoe in one 
or more fidds of endeavor. 



GOAL RATIONALE 

the notion of creativity has been various^ defined. It is used here to encompass 
worthwhile activities that children initiate and pursue on their own- activities having an outcome 
that is perceived by the children themselv^ or by others as a contribution to their world. Such 
activities can be found in a wide variety of fields, not only the sciences and the arts, but also 
the organization of human affairs and the development and exercise of salable skills in the 
production of practical things that enrich our way of living. 

The school environment should encourage and reinforce activities that can enable 
children to express themselves creatively and productively. 

MEASUREMENT RATIONALE 

Attempts to assess creativity have traditionally used methods which analyze the 
components of the creative process or subjective judgments about the quality of the {'^uct 
of the creative act Neither of these procedures is particularly well adapted to a large scale 
assessment effort which covers the broad spectrum of creative talent represented in the school. 
In order to overcome this problem a twa4imensional model of creativity was proposed which 
provided a theoretical basis for the assessment of Goal VII. The first dimension is based on the 
student-expressed interest in participating in creative activities, while the second attempts to 
determine the extent of recognition gained through active involvement This approach seems 
sound since the Goal VII statement stresses opportunities and encouragement for all students 
relative to creativity rather tlian emphasizing individual talent and production in any one area. 

GENERAL i»CALE DESCRIPTION* 

m 

The creative activities checklist contains 36 activities which require originality in visual 
arts, performing arts, science and writing. Sample activities include performing an original scientific 
experiment with Uving things, writing an origfaial poem, modeling an outift in an original way, 
performing an original magic or novelty act. 

Response options give six ways to show degree of involvement in each activity. Options 
are (1) No, and have not wanted to; (2) No, but have wanted to; (3) Ves, but with no recognition; 

*The creativity scale was developed by James F. Hertzog and ficAm F. Russell, both from the 
Division of Educational Quality Assessment 
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(4) Yes, with teacher or adult leader recognition; (S) Yes, with school-wi'^e recognition; and (6) 
Yes, with area-wide recognition. The scale contains four subscales each having nine items. 

Subscale 1: 

Visual arts contains nine items, some dealing with more than one acthdty. Activities 
include sculpturing; cartooning; printmaking; graphic design; painthig; photography; 
flower arrangement; design of window displays, stage sets, decorative items and dothing. 

Subscale 2: 

Performing arts contains nine items which hiclude activities dealing with singing, speech, 
music, magic, modeling, directing, acting and sports. 

Subscale 3: 

Writing arts has nine items related to writing such as poetry, news, essays, stories, scripts, 
letters, jokes and recipes. 

Subscale 4: 

Science activities contains nine items such as performing experiments using physical 
objects or living things, constructing models to show a scientific principle, exploring, 
training animals, directing recreational activities, developing campaign strategies for 
(school) elections, working with mdias or other electronic equipment and designing 
gadgets. 

NORM-REFERENCED SCORING 

All items in this scale are positively worded. Each item describes an activity and asks 
the students to describe the level of their involvement in that activity. 



Response Options Score Obtained 

(1) No, and have not wanted to 0 

(2) No, but have wanted to 1 

(3) Yes, but no recogni^on 2 

(4) Yes, with teacher or adult leader 

recognition 3 

(5) Yes, with school-wide recognition 4 

(6) Yes, with area-wide rece:;iition 5 



CRITERION-REFERENCED SCORING 

Two criterion-referenced scoring methods are used for this scale. The first defines as 
favorable those choices which reflect a willingness to try the activities presented in the scale. 
Thus only the option A'lo, and have not wanted to is considered unfavorable. Scores generated 
from this method are called Attitude Toward Creative Activities. 

The second scheme defines as favorable those choices indicating that the student h s 
actually participated in the acthrity. Thus two choices are con^dered unfavorable: No, and have 
not wanted to and No, but have wanted to. 
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BEST GOn MMUUBIE 




GOALVIH Vocational' Knowledge 

Quality education should help every child understand the opportunities open to him or her to 
pnpare for a producthe life and hdp each chSd to take fiiO advantage of these opportunities. 



GOAL RATIONALE 

Students should be aware of the vast array of po^bilities for continuing self-development 
in the world of work so that they wOl be motivated to pursue excellence hi aU forms of human 
endeavor that are appropriate for them hidhidually. 

Most children can profit from some form of education beyond high school, whether 
it be a foujvyear college, a school of nursing, a community coUege, a technical histitute or the 
like. Each student should be aware of these opportunities and seek out the khid of education 
best suited to his or her talents and hiterests. This goal also hnpBes that the school will provide 
students with guidance that will enable them to do sa 

MEASUREMBNT RATIONALE 

Vocational development, for purposes of assessment, is a seriw of processes involvtog 
both the acquisition of knowledge about different kinds of work and the forming of attitudes 
which will enhance one's chances of succ^ding in the work-8«day world 

In the initial stages of vocational maturity students become awaie of different kinds 
of work and w(»rkers. This is followed by a growing undeistandUig of the relatedne^ of educational 
and occupational opportunities. The more vocationally mature students wiU actively seek 
information, accept personal responsibility for career decisions and finally base their career didces 
upon a realistic appraisal of their interests, achtevements and aptitudes. 

The first stage, measured at this grade level, assumes that the awareness of jobs and 
job opportunities wiU lead to development of vocational maturity. 

GENERAL SCALE DESCRIPTION* 

This scale contahis 30 items which focus on the student's knowledge concemhig the 
duties, conditions, tratohig, salary and educational requirements of various occupations. The 
multiples;hoice format requires the student to select the best answer from alternatives. One point 
is given for each correct n^;>on8e. No adjustment is made for guessing. 



*The authois of this scale are Francis J. Reardon and James P. Lewis from the DWision of Research. 
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Sample items: 

Which of these jobs lequires • period of apprenticeship? 

*A. electrician 
B. stockbroker 
C porter 
D. truck driver 

A claims a4!uster would most likely be working for: 

*X. an insurance company 

B. a hospital 

C. a welfare ofRce 

D. a department store 
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GOAL IX Appreciation of Human Accomplishments 

Quality eductti<m should help every chSd to undetstaiid and appreciate as much as possible of 
human achievement in the natural sciences, the social sciences and the hnmanitfes and the arts. 



GOAL RATIONALE 



Students should be encouraged and helped to gain knowledge about human 
accomplishments. Possessfaig knowledge they win then be ready to receive and not to avoid the 
stimuli that the sciences and arts provide. At tho next level, they will be ready to more dearly 
and consciously perceive these stimuli and will begin to discriminate am«ig art forms. When 
they reach the next stage of development, they will be ready to respond rather than merely 
attend to phenomena-they will choose to see a piay, to read of a famous scientist or to contemplate 
the design of a building. 



Insofar as possible the school experience should provide an increasing openness to 
the life of the mind and an increasing ability to find meaning for one's own life in the heritage 
of the past and in the intellectual thrusts of the present age. 

MEASUREMENT RATIONALE 

Attitudes associated with the understandhig and appreciation of human accomplishments 
may be inferred from samplings of behavior taken at several points along a r^ponse hierarchy. 
The lowest point in the hierarchy is represented by behaviors indicating a state of passhre receptivity 
reflecting little more than an awareness that certain human endeavors exist. At the highest potat 
of this hierarchy are overt behaviors resulting in direct invohrement in the activities and inferring 
high motivation. Between these two extremes are several intermediate steps based on the value 
placed (»i the activities and willingness to receive stimuli that these activities provide. 

In developing the assessment model to be used in this goal area, it was determined 
that tiie instrument would not attempt to sample behaviors at either extreme, histead items were 
designed to concentrate on attitudes concerned with tiie degree of value placed by students on 
various areas of human accomplishment and the willingness of students to seek out environments 
where firsthand experience hi these endeavors would be possible. 

GENERAL SCALE DESCRimON* 

This scale contains 48 items measuring how much value the students place on human 

*The appreciating human accomplishments scale was developed by Joan S. Beers and Nolan F. 
Russell for the Department of Education. 
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achievements in the arts and sciences and the degree to which they are willing to vicariously 
receive stimuli from these endeavors. Areas included are literature, art, athletics, ecology, 
government, science, music and drama. The scale is organized into two subscales each haying 
24 items. 

Subscale 1: 

Valuing measures the amount of importan(» the student attaches to achievements in 
the arts and sciences and how much the student values the role played by people in 
these areas. Sample item: Most scientists don't care how their work affects people. 

Subscale 2: 

Receiving measure willingness to learn more about achievements in the arts and sciences 
and to seek out firsthand information on what peopte in these areas are dc^ng. Sami^ 
item: It would be fun to watch people paint at an art studio. 

NORM-REFERENCED SCORING 

The item weighting scheme used for norm-referenced scoring is: 

Resp<Hise Options 

Item Direction Agree Uncertain Disagree 

Positive 2 1 0 

Negative g | 2 

CRITERION REFERENCED SCORING 

Responses to this scale are considered favorable when they reflect agreement with 
statements which (1) stress the value of human endeavors in the arts, sciences, politics, etc, 
or (2) si^gest that it is personally rewarding to approach the people and places associated with 
these endeavors. For the appreciation of human accomplishments scale the following scoring 
sdieme is used. 



Item Direction Agree Uncertain Disagree 

Positive Statements 

1 0 0 

Negative Statements 0 0 1 
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GOALX Coping with Change mtmmmi 

Quality education sliould hdp every child to prepare for a world of rapid diange and u ifoieieeeble 
demands in which contindi^ education throughout adult life should be a normat expectation. 



GOAL '"ATIONAUE 

AbiUty to cope with a rapidly changing world is important for today's youth. The 
development of the abilities and their a^ociated attitudes which aUow the individual to view 
change as an opportunity rather than a threat pos^ a new challenge for education. 

Schools should help students develop attitudes of openness to the possit^ties of change 
- change in their personal worid as well as external change. Students should be encoiu-aged to 
show tolerance for uncertainty and to welcome new experience 

MEASUREMENT RATIONALE 

AtHlity to cope with change and deal effectively with frustration is essential to penonal 
adjustment. These adaptive behaviors are seldom learned hi response to external changes of great 
magnitude and import but are acquired as part of a gradual process reijuiring daUy changes 
in the life of the student. 

Assessment in this goal area attempts to draw upon several elements l»lieved to be 
associated with a student's ability to accommodate change and to adapt emotionally and 
behaviorally to unexpected or sudden alterations in the environment Primary among these are 
measures of the student's ability to tolerate frustration and uncertahity and to apply past leamhigs 
and coping behaviors in new and different sitttations. 

The situations presented as a means of measuring these attitudes and behavioral 
(fimensions were gleaned from student responses to open-ended questions asking for descriptions 
of events they had expericn^d which nece^tated some form of adjustment and which were 
remembered as being difGcult to cope with. 

GENERAL SCALE DESCRIPTION* 

Thirty-five items measure emotional and behavioral reactions to chani^. The scalers 
format contains seven stories describing unpleasant change situations in which student's 
expectations or needs are not met These situations were obtahied from previous student statements 
describing events that were difficult to adjust to. Five reactions predefined as indicating positive 



* The preparing for a changing world scale was authored by Nolan H Russell, Division of Educa- 
tional Quality Assessment. 
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or negative adaptation to change are given following each story. The purpose of the scale is 
to get at student reactions in r^ponse to a variety of events, not to predict what students will 
do in the particular situations presented. 

Sample situation: I was elected class president. I came home to tell my parents the good 

news. They told me that my dad had taken a Job out of state and we 
were going to move in two weelcs. So I had to withdraw from school 
and move. 

Sample items: If this happened to you, how much time would you spend on each thing 

listed below: 



A Great Very 
Deal of Time Some Time Little Time No Time 

1. Being upi^t 

1 Trying to find someone 
to stay with so I could 
remain in my school. 

3. Planning a goin^away party. 

4. Fighting with my parents. 

5. Reading about the place we 
are going to move to. 

Subscale 1: Effective solutions contains 13 items to measure the tendency to try solutions 
reflecting positive adjustment to change. In the above, sample items three and five 
are assigned to this subscale. 

Subscale 2: ineffective solutions contains 13 items to measure tendency to avoid use of 
aggressive or withdrawing reactions in face of change. In the above, sample items 
two and four are assigned to this subscale. 

Subscale 3: Emotional adjustment contains nine items to measure the perception of the length 
of time needed for the student to adjust emotionally to change. Item one above 
is assigned to this subscale. 

NORM-REFERENCED SCORING 

The item weighting scheme for norm-referenced scoring is: 

Response Options 

Type of Items A Great Deal of Time Some Time LittleTbne No Time 

Effective Solutions 3 2 10 

Ineffective Solutions * q 12 3 

Emotional Adjustment q 12 3 
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CRITERION-REFERENCED SCORING 



Responses are considered favorable when they reflect (1) a wiUingness to adyust 
positively, (2> an unwillingness to withdraw or become aggressive and (3) a rapid emotional 
adjustment to change. An Individual's score on a given scale (total or subscale) is the percentage 
of items to which a favorable rraponse was given. The item weighting scheme for the preparing 
for a chanj^ng world scale is: 

R^ponse Choices 









Very 






A Great 


Some 


Uttte 


No 


Item Type 


DealofTime 


Time 


Time 


Time 


Effective Sohition 


1 


1 


0 


0 


Ineffective Solution 


0 


0 


1 


1 


Emotional Adjustment 


0 


0 


1 


1 
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THE OVERALL PICTURE 



During the fkt \ two weeks of March 1974, 53,226 students attending 240 
Commonwealth intermediate schools completed the Grade 8 EQA Inventory. This reprints nearly 
a quarter of a million houis of studrat time. Do the outcomes which are summarized by the 
Manml for Interpreting intermediate School Reports accurately reflect student progress on the 
10 state education goate? To answer this question one must know where the t^ts came from, 
what they really measure, how accurately and reUabty they measure it, and how much influence 
faking and response bias have mi the final results. The following two sectims highlight the 
safeguards used to produce high quality instruments and show how the instruments stood up 
to these checks. 

A WORD ABOUT ATHTUDES 

Attitudes, beliefs, values, etc., are abstractions. Nevertlwless they are real enough to 
each bidividual holding them. They axe typically thought of as a state of leadiness-a predisposition 
to act or react in a certain way when faced with certain ^tuations. A person's attitudes are 
always present but remain dormant most of the time. They are expressed in speedi or other 
behavior only when the object of the attitude is perceived. A penon may have strong attitudes 
for or against astrology but actively express them only when some issue connected with astrology 
arise8-K>r when confh>nted by an attitude scale < Attitudes are often reinforced by beliefii (the 
cognitive component) and attract strong feelings (the emotional component) ^t will lead to 
particular behaviors (the action tendency component). 

The measurement of attitudes always involves making inferences. Since the attitudes 
cannot be seen or measured directly, we must infer their prei«nce torn consistencies fliat appear 
in the individual's behavior. ObservLng individuals across time in everyday situations is probably 
the best way to learn how the individual thinks, feels and acts. 

Clearly, this method is mudi too cumbersome and costly when we want to hivestigate 
the intensity and direction of attitudes for a large number of people, forcing us to rely instead 
on verbal reports of the individuals concerned. 

WHAT ABOUT PAPER AND PENHL TESTS OF ATTITUDES? 

The use of paper and pencil techniques for measuring attitudes is often questioned. 
These questions are directed at both the test and the test taker. Test critics are concerned with 
the possibilities that: 

1. People misunderstand what the items are asking. 

2. People don't always tell the truth on this type of test 

3. Scores on tests of this type are sekiom presented in any meaningful way. 

4. People might not respond consistently to similar questions. 

5. Ptople might respond to items differently at various times. 

In the development of the EQAI scales, these and other concerns were taken bito consideration. 



From the outset, aU pilot instruments were put through an obstacle course of diecks 
and balances designed to determine their susceptibility to various errors of measurement The 
tests were then revised and submitted to additional Held trials. This philosophy of testit^ the 
tests before using them to test people resulted fat a five-year developmental period requiring strong 
cooperation between the Department of Education and over 1 75 Commonwealth school districts. 
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YES. BUT CAN THEY READ IT? 



If students can't read the tests, the tests can't read the students. Although it is impossible 
to control the range of verbal comprehension in a program assessing over 50,000 students, it 
is feasible to develop scales that can be read and understood by the vast minority of respondents. 

Toward this end, monitors conducting field-trials were required to submit detailed reports 
on the understandability of directions, item sentence structure and vocabulary for each instrument 
Also, students were asked to comment on the scales and identify words and/or items Uiat didn't 
make sense to them. Changes resulting f^m these data increased the readability of aU EQA 
instruments. 

After each scale was flnalized, its ieadability level index was estimated by the 
Gunning-Fog formula. This formula takes into consideration both the average number of sentences 
and the percentage of three-ormore syllabic words contained in 100 words. The index is expressed 
in grade level terms. An instrument with a readability index of 5.0 should be undetstood by 
the average student just entering 5th grade. Nine scales within the inventory have Gunning-Fog 
readability indices ranging from 4.0 through 5.0. The creative activities and appreciating human 
accomplishment scales have n^adabilities of 6.0 and 6.7 respectively. 

Results from a study invohring a limited number of ^cial education students in a 
large suburban school district indicate that the majority of the tests comprising the battery need 
additional revision before becoming appropriate for our special education population. 

FROM ITEM CONTENT TO ANS^R SHEET 

Handing someone a list of attitude questions, waiting 10 minutes, then collecting it 
does not insure that the check marks you find in the answer column^ were made solely in response 
to the content of statements on the list. Those other factors influencing answers are called response 
sets. The two most common types of response set contamination are the tendency of respondents 
to tell you what they think you want to hear (make a good impression) or to randomly check 
answers without regard to item content. 

In their developmental stages, all scales and items were checked against a special 36-item 
instrument designed to pick up the tendency to make socially desirable answers. This scale* 
contained such questions as: 

( 1 ) / never forget to say please and thank you. 

(2) Sometimes I don't like to obey my parents. 

(3) / always finish my homework on time. 

(4) Sometimes I do things I've been told not to do. 

Those items and scales whose scores were found to be associated with socially desirable responding 
were deleted or revised to minimize the relationships found. The correlations between the final 
total instrument scores and a 304 tern version of the sorial desirability scale range from .04 throueh 
.08 (N«400). 

We have tried to minimize the effects of position bias by including both positively 
and negatively worded items in the goal scales. The creative activities check-list is Uie only EQAI 



*ltem sources for this instrument included the Crown-Marlow Scale ( 1 960) and the Childrens' 
Social Desirability Scale by Crandall ( 1 965). 
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instrument which does not contain reflected items. An estimate of response positi(m tHu can 
be determined by counting the number of perfect scores. To get a perfect score the stu(tent 
must answer Yes, I have done this activity and ftave received area-wide recognition for its quality 
to each of 36 separate activitles<-a highly questionable feat! Fewer than one-half of one per 
cent of the 50,000 respondents obtained a perfect score on the scale. 

FROM ITEM ANSWERS TO TEST SCORES 

To give school personnel a clearer picture about the performance of their students on 
the EQAI, two scoring methods are used for each attitude scale. The first scoring method organizes 
the response options with each scale into a hterarchy. Different scoring weights are then ^plied 
to each level of the hierarchy. Consequently, for an item such sa / tike school with response 
options (a) strongly disagree, (b) disagree, (c) agree and (d) strong agree, wei^ts of zero through 
four are applied respectively to each answer choice. This method is based on the assumption 
that strongly agreeirig with a statement is more positive than merely agreeing with the statement. 

Item scores obtained by this method are summed and used to give normnreferenoed 
information about student performance. How weU a group of students perform on the scales 
is determined by the relationship of their scores to other student groups. This norm-performance 
tells very little about favorableness of student responds. 

To obtain information about favorable and unfavorable responding, a 
criterion-referenced scheme is used. This scoring method is based on the notion that each item 
within the scale offers the respondent the chance to show a positive or negative attitude toward 
the specific content presented by the item. Hence, the response choices to the above item are 
scored by assigning a one to both the strongty agree and ogive choices and a zero to the remaining 
choices. 

The number of positive responses given by each student is compared to an independently 
determined standard or criterion. If the number of favorable responses meets or exceeds the 
standard, the student is said to have achieved the standard. In the case of soil^ used in EQAI, 
three criteria were set: Level One requires student to respond favorably to more than 35 per 
cent of the items; Level Two requires favorable responses to mote than 50 per cent of the 
items. Level Three requires favorable responses to more than 70 per cent of the items. 

RESPONSE CONSISTENCY WITHIN THE TESTS 

Reliability is that characteristic of a measuring instrument which deals with consistency 
of results-either within the scale itself (internal consistency) or over time (stability). Reliability 
coefficients are reported as two>pIace decimal figures ranging from ,00 to 1.00. As the instrument 
increases in reliability the coe^cient increases in value. 

Reliability coefflcients are interpreted as the proportion of the variance in a set of 
scores which is caused by variation in the examinees true scores, mther than by errors of 
measurement. 

The coefflcients are derived by taking into account the length of the test and the extent 
to which test items contribute mutually confirming or consistent information. 

The KR-20 reliability formula is used for the knowledge scales scored on a right vs. 
wrong basis. For the attitude scales, coefficient alphas give us estimates of scale and subscale 
internal consistency. Internal-consistency reliabilities based on criterion-referenced scoring of the 
scales ure obtained using Livingston's formula.* As the magnitudes of these coefficients increase, 

Livingston, Samuel A., Criterion-Referenced Applications of CHassical Test Theory Journal of 
Educational Measurementydi, 9, No. 1, Spring 1972, pp 13-25. 



we can be more confident that erroiB of measurement are unlikely to make a difference between 
meeting or not meeting the criterion for many of the examines 



Table 1 presents seven separate internal consistency estimates for each sub and total 
EQA scale. These are based upon a sample of 3,500 student records randonify drawn from an 
240 schools administering the inventory in March 1974. Therefore, these reliability fln(Hngs can 
be generalized across various schools, communities and test settings wi^ the Commonwealth. 
Sub and total scale names are presented in acronym form. For complete names refer to Sectiwi 
One. 

To clarify test appropriateness for students of differing reading and achievement levels, 
coefficient alphas are given for low achievement (N«I160), average achievement (NellSO) and 
high achievement (N«1080) students groups. These groups are defined by scores on the composite 
math-verbal scale. 

As a rule of thumb, Kelley* has proposed that tests de^ed to discriminate between 
groups should display reliabilities greater than .SO. Note that wily three subscales (CONTENV, 
SES, and INTELL) fail to meet this minimum criterion and then only for the low ability student 
grouping. Also evident from Table 1 is the increase in -^liability for most scales as ability level 
increases and the high reliability obtained on all total scale scores. 

The three extreme right columns of Table 1 show criterion score reliabilities of 3,500 
records across the three criteria levels. Here again the reUabilities are very high. This indicates 
that the tests are capable of eliciting consistent responses from students. 

Other indicators of internal consistency available in printout form at the Division of 
Educational Quality Assessment in Huxrisburg are ratios between standard-error of measurement 
and standard deviations, average inter-item correlations and items-to-total correlations for all sub 
and total scales. These indicators confirm conclusions obtainable from Table 1. 



T. L. Kelley, Interpretation of Educationa! Measurements, New York: Harcourt, Brace, and 
World. Inc. 1972. 
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RESPONSE CONSISTENCY OVER TIME 



Two que$ti(»is relate to stability of test scores. Do students stay in the same rank 
order position relative to one another from one test occasion to the next? Do students who 
are classified as having positive or negative attitudes remain in their respective categories across 
testing occasions? The fkst question is answered by computing correlations between the two test 
scores obtained at different points in time. The latter is answered by adding the percentage of 
students who stay in the favorable attitude classification with tiie percentage remaining fai tiie 
unfavorable classification. 

In February and March 1974, data on test stability for eight of the 11 scales over 
a four and one-half week period were obtained from 400 8th grade students in a large school 
district in southeastern Pennsylvania. Test administration followed procedures recommended bi 
the EQA statewide MorUtor's Handbook. A second study involving 120 students attending a 
school district in western Pennsyhrania produced stability estimates for tiie remaining three scales. 

Table 2 presents test-retest conelations developed from norm referenced scores on all 
sub and total scales. An index of continuity for scores on eadi of three criterion scoring levels 
is also given. This index tells us the per cent of students remaining in tiie same scoring category 
(i.e., those passing on the first occasion who also pass on the second occasion or those failing 
on tiie first occasion, who also fail on the second occasion). From this table it can be seen 
tiiat the total scale reliabilities are quite high and range from .73 through .81. The continuity 
index figures show tiiat a large percentage of students don't change their answers sufficiently 
across testing occassions to be placed in a different category. 
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TABLE 2 



TEST-RETEST REUABIUTY AND OONTSMUITY INDICES 
FOR SUB AND TOTAL EQA INSTRUMENTS 



ScateName 


Tett-Retest RenabiUty 


Indices of Condnuity 
(Criterion Scoring) 

Level One Level Two 


Level Three 


CSELF 


.73 


91% 


81% 


80% 


CONTENV 


.63 


95% 


87% 


81% 


RELATE 


.79 


94% 


86% 


85% 


t>vnjLiivi/\Vi 




86% 


79% 




TOTAL SCALE 


.80 


96% 


88% 


84% 




.0 / 


83% 


78% 




REUB 


.72 


sm 


77% 


79% 


SES 


.62 


88% 


80% 


83% 


INTELL 


.64 


80% 


70% 


80% 


rtAINUCr 


•Of 


86% 


92% 




TO FAL SCALE 


.76 


91% 


82% 


83% 


GOAL-3V 


.79 


N.A. 


N.A 


N.A. 


G0AL-3M 


.81 


N.A. 


N.A. 


N.A. 


LEARN 


.74 


87% 


80% 


81% 


SCHOOL 


.81 


86% 


84% 


81% 


TOTAL SCALE 


.81 


88% 


84% 


81% 


WbLrUlvf 


. 0 / 


71% 


78% 




LAWAUTH 


. 70 


73% 


79% 


89% 


RESPINTG 


. 68 


73% 


79% 


88% 


TOTAL SCALE 


.73 


77% 


84% 


91% 


PHEALTH 


.67 


71% 


78% 


85% 


C A CCTV 

SArtI 1 


AO 




1 1 fO 


oiyo 


DRUGS 


. 75 


87% 


83% 


81% 


TOTAL SCALE 


. 71 


84% 


76% 


88% 


VISLART 


.63 


79% 


75% 


80% 


PERFMART 


. 54 


73% 


73% 


80% 


SCIENCE 


.60 


84% 


78% 


76% 


WRITING 


. 56 


84% 


80% 


76% 


TOTAL SCALE 


. 64 


87% 


80% 


80% 


G0AL-8K 


. 76 


N.A. 


N.A. 


N.A 


VALUING 


.66 


N.A. 


N.A. 


N.A. 


RECEIVING 


.75 


N.A. 


N.A. 


N.A. 


TOTAL SCALE 


.75 


N.A. 


N.A. 


N.A. 


EFFSOLN 


.63 


87% 


11% 


75% 


INEFFSOL 


71 


92% 


84% 


78% 


EMOTADJ 


^8 


70% 


86% 


87% 


TOTAL SCALE 


,5 


91% 


82% 


77% 
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WHAT IS VAUDITY? 



Validity is evidence-evidence that helps us separate fact from fiction concerning test 
results. In the case of the Educational Quality Assessment Program, information on the validity 
of each scale can help state educators translate the paper goals and number outcomes into a 
better understanding of Pennsylvania school age children. No single procedure or experimental 
design gives a complete picture of a test's validity. Instead each study, in its own way, helps 
round out a picture of what each instrument measures and, therefore, aids our interpretation 
of test outcomes. 

Most test manuals at some point addrei» themselves to questions of validity and 
reliability. Underpinning these concepts are the more basic questions of the interpretabiUty and 
usefulness of information engendered from the test. The internal structure characteristics of the 
EQAI instruments which are presented in Section 3 offer initial evidence of the tests* useability 
by demonstrating empirically that the scales can elicit c(msistent student responses both within 
sets of similar items and across time. Low susceptibility to faking and ease of readability also 
support the premise that the vast m^ority of 8th grade students can interact ea^l> with the 
battery in the test-setting. 

The internal structure of tests also can be examined by asking students to describe 
their general reactions to each scale and asking professional educators to judge the appropriateness 
of contents of each scale. 

ALLOWING STUDENTS TO REACT TO THE INVENTORY 

During fieldtesting, a six-statement questionnaire was inserted at the end of each 
proposed EQAI scale. Students who were selected to respond to the questionnaire represented 
a range of high, average and low socioeconomic backgrounds attending urban, suburban and rural 
schools. Approximately 300 students per EQAI scale responded to the spedal questionnaire. For 
example, students who had completed the Goal I-Self-Esteem scale were asked: 

1. In general, do you feel that the questions get at 
self-understanding ? 

(Please circle Yes or No) 

2. Do you think you answered these questions honestly? 
(Please circle Yes or No) 

3. Please write a sample question that would better reflect 
self'understanding. 

4. Go back through the scale and identify those statements which 
you had difficulty understanding. Please write down the 
question numbers. 

3. Please list the words which you fmd difficulty understanding. 

6. General comments. Here is a chance for you to write any 
comments you might have about this scale. 

Data obtained from this procedure were used to refine the instruments and to obtain 
estimates of face validity. The percentage of respondents agreeing that particular tests appeared 
to reflect the trait of interest ranged from 93 per cent for the creative activities scale through 
98 per cent for the Goal III mathematics test. An average 96 percent felt that they had responded 
honestly to test items. Responses to question six indicate that fewer than S per cent of the 
students felt that time spent completing the scales was wasted (i.e. they thought the tests were 
stupid, not relevant, or unrealistic to their personal lives.) 
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JUDGMENTS OF TEST CONTENT BY EDUCATORS 



When constructing tests to be used in a statewide assessment program, it is extremely 
important to make systematic efforts to insure that item and scale content are both logically 
and empirically related to the concepts they are designed to measure. From the outset, content 
specifications were developed for each goal area. Items and test formats were then designed to 
reflect these spedHcations as closely as pos^Me. Woiidng papers for each instrument-describing 
its item development and election procedures-together with its content nutp, are available at 
the office of the Division of Educational Quality Assessment in Harrisburg. 

During all stages of test development, curriculum specialists from the Department of 
Education, together with measurement researchers and local school district personnel, judged item 
content, scope and appropriateness. In addition, 40 teachers and administrators from the Cariifie 
Area School District who had undergone a IS-hour training program in quality assessment 
procedures were asked to rate each final instrument in terms of item and content appropriateness. 
The lowest agreement of content appropriateness was found for the creative activities scale (90 
per cent thinking the test adequately measured the concept). Between 94 and 98 per cent 
agreement m content appropriatenei^ was obtained for the other 10 scales. 

STUDENT SCORES vs TEACHER PERCEPTIONS 

The miuor purpose of the quality assessment proce'iure is to identify student progress 
in the 10 quality education goal areas. This will enable educators to more clearly focus curriculum 
efforts on student strenghths and weaknesses. The ability cf teachers to identify student needs 
by classroom observation techniques is germane to meeting student needs or maintaining already 
high levels of student achievement An important question in this rei^ is: Do student test scores 
correspond to teacher judgments based upon obsermtU>ns of student classroom behaviors? 

Faculty and administrators from both the middle (N=:8) and senior high schools (N<=20) 
of Carlisle Area School District participated in a 1 5 hour in-service workshop sponsored jointly 
by the state educational department's Bureau of Curriculum Services, Capitol Area Intermediate 
Unit and the Cariisle Area School District. Training was conducted by Division of Quality 
Assessment personnel and was designed to communicate the nature and substance of the EQA 
program and to familiarize teachers with goal measurement rationales and test content. 
Concurrently the entire student body at both grades 8 and 1 1 completed appropriate forms of 
the EQA Inventory. After initial training in classroom observation techniques, teachers were asked 
to nominate the highest 20 per cent and lowest 20 per cent of their students in the areas of 
self-esteem, tolerance, attitude toward school and learning, citizenship, health habits, creative 
performance and coping with change. 

Each student was then assigned a score based on the number of high or low nominations 
the student received. Each score was a ratio formed by taking the number of positive high 
nominations minus the number of negative low nominations dhided by the number of possible 
nominations. Distributions formed from these scores were then examined in order to place students 
into high and low groups for the purpose of analysis. 

The number of students in each group varied itom goal to goal and typically ranged 
from 7S to 100. Differences in mean scores between the high/low groups were statistically evaluated 
via a series of Fisher-Behrens t tests which correct for biases assodated with unequal variances 
when sample sizes are unequal. 
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Table 3 presents the mean scores for the high and low teacher nominated groups, the 
t value along with its associated level of statistical significance and the point biserial correlation 
coefficient between group membership and scale scores. Scale names are given in acronym form. 
As can be seen from the probability column, student scores on five of the seven composite 
instruments ore significantly related to teacher perceptions. 

Statistically significant relationships between teacher i^rcepticm of d^sroom behavior 
and test scores are found for the total scale and each subscale for Goal I-self-esteem, Goal 
IV-interest in school, Goal V*dtizenship and Goal Vl«health habits. This indicates that teachers 
were readily able to observe characteristics in their students which were also picked up by the 
student's responses to the test items. The relationship found for Goal II is si^iiilcant for the 
total scale and three of the five subscales. The race and religion subscales failed to reveal significant 
differences. Student tolerance toward others of a different race or religion may rarely be expressed 
in this school and, therefore, be observed by teachers too Infrequently to serve as a reliable 
basis for classification. Only one subscale for Goal X-coping with change was significant. Again, 
circumstances in which teachers might observe students with regard to this characteristic may 
appear very seldom in the classroom environment None of the Goal Vll-creative performance 
scales showed reliable relationships with teacher perception. 

Table 4 gives a criterion-referenced perspective to the results of the Carlisle study. The 
per cent of students passing at each of the criterion scoring levels for high and low groups are 
shown. Also given is the difference in the per cent passing between the groups and the level 
of statistical significance of this difference based on test results. 

Note that the interest in school and citizenship instruments show significant differences 
across all three criterion levels. 

The creative activities scale shows statistically reliable differences at the second criterion 
level. Recall from Table 3 that this scale failed to discriminate between groups when norm scoring 
procedures were used. 

All seven instruments investigated in this study show the ability to discriminate between 
teacher-selected high and low groups on at least one, and in most cases more than one, criterion 

level. 

The combined norm-referenced and criterion-referenced results give strong support to 
the notion that teachers, through close classroom observation, can identify generally the same 
stude; ts that the tests show to be above average or below average on the seven general traits 
measured by the EQAI. 
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TABLE 3 



CORRESPONDENCE BETWEEN TEACHER NOMINATIONS AND 
TEST SCORES FOR SEVEN EQA INSTRUMENTS 



SCALE NAME 



CSELF 
CONTENV 
REUTE 
SCHLIMAG 
GOAL I TOTAL 

RACE 

RELI® 

SES 

INTELL 
HANDCP 
GOAL II TOTAL 

LEARN 
SCHOOL 
GOAL IV TOTAL 

WELFDIG 
LAWAUTH 
RESPINTG 
GOAL V TOTAL 

PHEALTH 

SAFETY 

DRUGS 

GOAL VI TOTAL 

VISLART 
PERFMART 
SCIENCE 
WRITING 
GOAL VII TOTAL 

EFFSOLN 
INEFFSOL 
EMOTADJ 
GOAL X TOTAL 



H Group 



Stttistic 



L Group 



Prob. 



Ft. Biseriilr 



19.27 


16.77 


148 


.01 


.23 




19.21 


2.36 


. 01 


.22 


20.82 


16.79 


4.15 


*0001 


.37 


laos 


15.06 


3.05 


. 001 


.27 


79.25 


67.98 


3.68 


* 0001 


.33 


12.61 


1 1.76 


i.32 


N.S. 


.11 


1Z08 


10.98 


1.45 


N.S. 


,12 


13.24 


11.98 


2.21 


• 05 


.18 


11.73 


10.61 


2.08 


.05 


.17 


13.33 


1132 


1.82 


.07 


.14 


62.96 


57.56 


132 


.05 


.18 


44.07 


38.62 


3.90 


.0001 


.34 


42.58 


32.00 


6.06 


.0001 


.50 


86.63 


70.66 


5.58 


.0001 


.47 


Id SiA 




5.45 


. 0001 


37 


26.91 


20.23 


5.94 


.0001 


39 


22.46 


17.77 


4.53 


.0001 


31 


70.21 


54.52 


6.13 


.0001 


^1 


29.80 


26.:*2 


155 


.01 


.19 


19.32 


17.21 


114 


.05 


.16 


25.39 


21.20 


4.76 


.0001 


34 


74.46 


65.34 


3.84 


.0001 


as 


12.32 


11.52 


.67 


N.S. 


X)$ 


8.76 


8.25 


.49 


N.S. 


j04 


13.33 


13.23 


.08 


N.S. 


XX) 


11.43 


13.36 


- 1.70 


N.S. 


-.14 


45.84 


46.34 


.12 


N.S. 


.01 


24.22 


23.33 


1.12 


N.S. 


ja9 


28.21 


25.49 


151 


•01 


.19 


12.79 


14.13 


1.66 


N.S. 


.14 


65.45 


62.96 


1.21 


N.S. 


.10 



Note - N.S. - Not statistically significant at or above .05 probability level. 
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RELATED STUDIES 



BEST am AVMUIBU 



The Division of Research and the Division of Educational Quality Asse^ment have 
sponsored a variety of independent studies designed to give further insight into the validity of 
the grade 8 battery. The abstracts associated with these studies are given on the following pages 
in goal number order. Complete data for these studies are available upon request at the office 
of the Division of Research. All abstracts have been prepared by the researcher responsible for 
conducting each particular study. 



Thf purpost <^ mt nu<ry to pro^e behiv{(^-r«t4ted crfurrton valNiltv for the EQA Qoat II mtt at grtdt & 
This ttiKly immtifl«t«d tl^ extern to v^U:h the tolerant behavior* of the ttudents related to their Goal if ieit loorei. The behavioral 
criteria ^re peer ratinai. The itudenti were asked to seteot five of their dasimates who wmitd nwt ffk^fy, and five of their 
cUttsmates who would fmst iik^fy, perform each of four tolerant behaviort. Tf^ students were aslced to indicate whether each 
•election vmt based upon race, religion, physicai handicap, tocioeconomic status, or intelligence. 

The sample consisted of 62 white and 29 nonwhite 8th grade students from two urban Pemtsylvttiia letiool districta 
for a total of 91 itudents. Three classrooms were letected frmi one district and one classroom from the other distrtot. 

From the total ratings observed for each stuctent, high and low ^ups ware selecml and compared on the Goal tl 
tests. In addition, the total ratings were corrected with the Goal II tests. Modest validity support was found for the religion, 
socioeconomic status, and intelligence subtests, and the total test. Mo support wh found for either the raea or the physical 
hendteap subtest. 



A socMometrie measure wm us^ to validate the Pennsylvania Educational Quality Asiessmam Ooel 11 instruments for 
5th, 8th and 11th grades. These instruments wore developed to measure students' aoceptan^ of persons who cfiffer from them 
In race, socioeconomic status (SES), Intelligence, religion and persons who have some hendf<^. 

0o^ the sociometric measure end the Goal M instruntents were administered to (Hie 5th, one 8th end one 11th grade 
class in a Pennsylvania school district. All class<» had adequate f^-oportions of race, SES levels and intelligenca levels for comparisofi 
of student ^ores on the two measures. Although it v<^s not practical to compare EQA subscates on religion and hamfi^pped 
with the sociometric measure, it seems resaonable to assume that these scal^ will perform similarly to SES and intelligenco 
level difference subscales- 

The basic anumption of this study was that If student scares on the EQA measures accurately predicted student behaviors 
toward differing others, then the EQA instruments could be ece^ted as heving adequate validity for IneluskHi in the battery 
of t»ts. The results of the study showed that, with the exception of the race nilMcale in the 8th j^ade and the 11th grade 
subsoale on intelfigenM levels, the EQA Goal II Itmruments aorurately predicted student behavior n Indicated by the sodometric 
me^re. 



Students in three school districts representing a ruraNuburben^urban continuum toolc the EQA Goal IV Instrument. 
Additionally, a survey instrument which esked the students a number of questions about themselvN was administered* High 
and low scoring students on the EQA instrument were then compared on wiirii^es that were otitained by the survey questionnelre. 

Very large difference appeered between the two <^oups on such vsriables as how far the student wished to go in 
school, amount of tinte spam studying, occurrence of unexcused absence from school, grade point avennia and paying attemlon 
in c^n$. Smaller, but still significant, differences existed in such variables as number of books read over a recent period end 
iMiether or not the student generally completed assignments on time. Data in the form of student ccMH^t retings were collected 
from an administrator at eech school* The high and lew scoring groups faiied to differ on these mMSures* 



DO EQA GOAL II VS&l %ORES AGREE WITN PEER RATINOS? 
Gregory A. Shannon 



VALIDATION OP THE PENNSYLVANIA EDUCATIONAL QUALITY ASSESSMENT 
INSTRUMENTS TO MEASURE STUDENTS' ACCEPTANCE OF DIFPERINO OTHERS 

Peggy Sunk 



* 



VVMICH STUDENT BEHAVIORS RELATE TO EQA QOAU tV TEST 8CORES7 
Jtnrn R. M»t»r«, Gfegorv A. Shannon and Franc** J. Rtanion 
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Eictrtmtfy hl^ mtd low icorit on tfi« EQA Qoil tV tttt difftf mtrlndly on iMait Mtiviorai virMMtt thit indicate 
potiiivt attliudtt. Such a fim^ng (amU a i^t of supfNirt to tht wHdlty of tht 8th oradt imtiwiam ai • maaiura of 
niictvit attltiHla toward tchool. 

DISCnmiNATIOftf OF CinzeNMIf* CHARACTERffiTtCS 
IN AN INSTITUTION fOH NSOkECTEO ANO DEUNOUeNT QIRU 

F. Rumil 

Thu ftudy ¥m conductad In a homa for wayiMfd looatad k\ wa itarn Fanmytvafria* Tha Imtitiitton fm a fmnt 
policy of parlodie appnUs^ {avtry dMa montitt) of aaeh ratMmt'i social md emotional ai^Mtmant. EvdiMiont ara mada by 
a ttvta-mtfnDar mm IndtKSng a iwyehotoa^ a cast wonctr mi a cottagt attendant. CharactarMea imfiioti ara avifuattd induda 
panonal rcsponslMity. fionatty, f ightmg baha^ors ami ability to gat ^ong with othart. Ani^pimanta to tivit^ oumtm ara mada 
commgant upon tha abova aviluationi* Ai a ^I'f adfustmant improm, ilia to mo^ to am^har Mttogi with glrH of Umllar 
adMti^nant and with mora privHagat. Thara nra f ivt cottaga units in tha institution with cottaga numtNNr fiva houamg tha mmt 
mijmnd of tha studantt. 

Tha scaia wm adminlstarad to tha antira population of girts (N-4SI living in tha Inatitution^ For purpotaa of amMysii 
tha girii wara saparatad into two »oui^ Thosa living in dw fNrst thm cottagu formed group one itntm 4mf§dfu$t^ N«2B) 
Orouptwo (m€9tm^/$imf, N»21) was composed of ^% houMd In anti^ fdur and fiva. 

Analyses raveeled that the citixanship mie could (1) c^crimlneta between these two groi^ (the adtt^tad group Ing 
higher), and (2) discrlminete between d>a total institutional groi^ and a group of public school children having tkm home 
baclcgrounds (the public school group scoHng hli^h 

TH6 RELATIONSNIF BfiTWEMtf THE EQA GOAL Vll SCCHlEt 
ANO SELECTED AREAS OF CREATIVE ATTITVOE ANO OUTVUT 

Gregw A. ^lannon and J«nas Mastam 

This study was designed to obtain validity supp^ fcr tha EQA Goal Vll striMats and tha total test when seosned 
by eidvar dte norm-referenced or tfM criterlon-referenca j ^thod. The sample consistad of 3B grade 8 studnns from a fuburban 
Pennsylvenia school district. 

The cHtw'ion meesurat included a queatimnaire and a samentic differamial instniment. For mch activity described 
in the C ii Vll teat the questimnaire asked about the students' willingness to do the eethrity, how much they felt dwir school 
would encourage them in it, die gnde leval at which the students Im performed the activity, and tha nunibir of times eai^ 
activity ^ performed chiring the previous two years. The second iiuttvment atlced the students to respoml to adfcctlus wordiiaks 
descr^ng how they felt about working on visual artt, performirKi arte, writing and sclent proiacts< This instrumsnt yialHed 
meesures of how much the students vwiuid like to do the activities, how competent they felt about doing the activities, and 
the sxtant to which they felt that their teacher would encourage them. 

ValifSty support wis found for dte total Goal Vll tist and all of dw subtests vvNn> tcond by eiJwr of the two 
scoring mediodi, eitcspt the output scores of the visual arts n»btett. Students who eemed high scores on tha total tsst tended 
to enjoy working on eraetWe ecthrttles. Students who earned high scores on the subtests tended to ha« a poaMva atdtuda 
toward doing the activltiss described by eech subtest* Student who earned Mgh meirm on the performing m« writing and 
science subtests tsndsd to havs performed these activities at aitfier the 7th or the 8di gradi level. 

Thus, the stui^ done in tS74 support the validity of this t»t by showing a positive relatloi^ip between EQA God 
Vll tsst scoTM end ^-reports of student behaviors and attitudes. 

GOAL iX^RAOE S VALIDITY STUDY 
Grace E. Laverty and Joyce S. Kim 

Goal iX was validated by a correlational stiHiy with si»>ras from tha EQA inventory subecalas compered with diolcas 
made in the ssn« content aree on e nrvey of possible field xrlp§ and presentations. 

The semple included 66 eighth grade pi4>ils from a school reprmnting suburben and rural rommunhias snd t«rlous 
socioeconomic levefs. The 8th grade sample was taken from two social stuctfes d&sses wWch were completely hattrogsneous 
groups. Thus, ttie sample for testing was fa^iy rapresentathfe of die 8th graders In the sdiod. 
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TKt fHiiittf eompltM tfit EQA invtmory M>d • lurvty of ipiciti tvma mitnted m poiiiMf ftoM trfpi or ififcial 
proottint, Thty were ttktd to miwt m many of ttte 18 eventi n Aty inmid bt Inftnmtd In WteiHttiij. Tht anilyt^ coniMrttf 
thrtr choicti m aodi of itit nint ^nttnt irtit with thtir etort on tht tfwtn^ itttm rtprtsontifiv th« cootont tm. 

A limllaf itudy vm done at grades B« 8 and 11 . Over alt and contant araat. repreiantlnQ 30 ftpatiitt cormlations, 
eoefftefmu wm% pofktiv« except for one. The 8th grade analyifs ihoiMd poUtivt eorrelettoni In all Bmm and on the overall 
tan, emi all Mre atatiftteally tignif leant exo^ wodd events and icienai. In genml, the ^ndwice gathered by compare actual 
choicei by ttudentB In the survey of special events with theN^ m^es In the relaM Ma of Ooel IX lnventory-«iaasted that 
^ imtniment measwring aHltudes wid vitftm In then Mas of hmrain accomplishment* 

DO EQA OOAt X SCORES AGREE WITH TEACHER RATINOS OP STUDENTS' ABILITY TO ADJIST TO CHANQE? 

J^nes R» Mmeti and Gregory A. Sianrnm 

A suidy of the Instrument's valUfity «m conAicted In e suburtMn s^ool cHstrlet vifhare e large peroentaga of the studmt 
population had undergone change In their Hves. Approxlmatety 60 8th pM6$ studmts v^ had ejqj^lanced e greet deal of change 
(termed the Change groups and 60 8th riKte students v^o h^ experienmt little ^nge (termed the Nonehange groi^) participated 
In the study. The Change group had lived ttirough such upsets as parental cfivmes, separations or daeths, or had e^^enced 
at least two residential movements. Because they had lived trough ^nge, their dlfiy-to^ behevlwr would reflect how well 
they had bsen abte to deal with It. Also, since situattons described In the EQA Instrument would be similar to those they 
had experienced^ their fKetSctions of behavior would be expeetad to be nwe eccuratt than dme of others In their scho<^» 
From the 120 students, nechm were asked to choose students and ftH¥ In emoatorM/ Am Mudls Hief Ined as the 
ability to 1) recover from a sarioiM tmo^ionel setback, 2) confront dIfflcuH obatadas, and 3) discipline and dhract one's own 
bahavior in orcto to echleve a goal. 

For the Change group, those ret^ hf^ tcomi higher than those rated taw on both the Ineffective solutions sirfsscale 
and the total limrument. For the Mond^nge group no differing were found betvmm Ngf^ and k>m for any subacale or 
for the total instrunmt 

Suppon was found, therefore, for the ^lidity of both the imiffectlve solutlot^ subs^ end the total Instrument In 
addition, stu<^nts had little difficulty placing themselves In tf^ situations prmnted in the Instalment, and 92 per cent felt 
confident that *heir raipontes acoirately reflected their actual behaviors. 



VAUDITY INFORMATION FROM FACTOR ANALYSIS 



Factor analysis is a term used to describe a set of statistical procedures which can 
be used to analyze the interconelations among a set of variab<<» such as test scores. Factor analysis 
aids us in interpreting these relationships in terms of underlying /ac/ors and gives us insist into 
the amount of variation in each separate EQAI instrument which is asociated with each of the 
hypothetical factors. In the general sense, factor analysis presents a picture of how students respond 
to the test battery in its entirety by showing how the scale scores within the battery duster 
together. 

Factor analyst begins with a correlation matrix of all the instrument scores contained 
in the battery. For the purposes of this publication, the matrix presented in TaUe S is limited 
to the 26 subscales and the math and verbal instruments. All subscale names are given in acronym 
form due to spa(% limitations. This tabte has two X and Y a>lumns per page. In each column 
set acronyms for two subscales are given together with the correlation coefficient for that pair. 
Correlations are based upon approximately 3500 student records selected from the March 1974 
testing period which constitute a systematic sample from the data tape containing about 50,000 
student records. 

A series of analyses* were performed on this correlational data which l»lped identify 
the underlying factor structure of the EQA Inventory. This structure may ^ -^ inferred by examining 
the clusters of subscales displaying correlations to a given factor. Resuli^ wf these analyses are 
presented in Tabte 6. 

This table lists the subscales in the left hand column. The coefficients in the body 
of the table are correlations between each subscale and the eight factors listed horizontally near 
the top of the table. Th^ correlations are called factor loadings, and define, the factor by showing 
how much each subscale is related to it. The highest loadings for each factor are highlighted 
by a box drawn around them. By looking to the subscale names associated with these loadings 
(^e can understand which subs^es describe the factor. 

FACTOR ONE: RESPONSIBIUTY FOR WELL-BEING OF SELF AND OTHERS 

Factor one appears to be composed of the citizenship (Goal V) and health (Goal VI) 
subscales. That these two goal areas cluster is due in part to methods used to obtain scores. 
Both tests have identical formats: persons are asked to put them^lves in a make-believe student's 
p\906 and decide whether to take Ideal actions under a variety of motivation-including conditions, 
(i.e., peer pressure, reward, etc). 

Although the clustering of these subscales appears to be artifact of type of format 
ttsed to elicit students' n.>sponses, a common variable also seems to be mkrored by this factor. 
Each of .the subscales in this cluster require that the students exhibit a sense of personal 
responsibility for their own well-being and the well-being of others in relation to health, safety 
and social interactions. 

11 . 

* Extraction of principal components foUowed by variance rotation-See Harmen, H. H., Modem 
Factor Analysis. Chicago Press, 1960. 
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FACTOR TWO: ATTTFUDE TOWARD CREATIVE ENDEAVORS 



This factor is chiefly defined by the creative activities subscales indicating that the Goal 
VII instrument tends to give information about students, which is relatively indep>endent from 
that offered by the other EQAI scales. The relatively high correlation of this factor to the Goal 
IX receiving subscale, shows that people who like to participate In science, art, writing and 
performing activities also like to observe others who are recognized as being proficient in similar 
areas. 

FACTOR THREE: SELF-ESTEEM 

The subscale cluster comprising this factor is basically associated with the self-esteem 
instrument. In addition, a clear relationship is also found between this factor and the interest 
in school (Goal IV) subscale. This is understandable since many of the items in the Goal I test 
attempt to assess self-esteem in the context of the cla^room environment. Therefore, it is not 
surprising to find that some students who have a good self-concept in the school setting also 
tend generally to have positive feelings about their school experiences. 

FACTOR FOUR: TOLERANCE TOWARD OTHERS 

How comfortable students feel when coming into contact with others differing m racial, 
religious, wealth, intellectual, or physical attributes forms the base of this factor. This feeling 
state also has an action counterpart which is mirrored by the idency to refrain from behaviors 
that might harm others. Evidence for this action component . shown by the significant positive 
relationship between the Goal V citizenship subscale*concem tor welfare and dignity of others 
and this factor. The Goal IX valuing human accomplishments subscale also relates to this factor, 
demonstrating that the tendency to stereotype others in a negative way is also related to the 
person's intolerance of others. 

FACTOR FIVE: BASIC COCNmVE SKILLS 

Th » factor is composed of the three basic skills measures (math, verbal and vocational 
knowledge) and the Goal VI drugs subscale. The positive correlation between the Goal I control 
of environment subscale and this factor sug^sts that students who are more successful in school 
achievement believe that they can influence, to a ^ater extent, their personal destinies. 

FACTOR SIX: VALUING THE EDUCATIONAL EXPERIENCE 

This factor is complex In that it is defined by various subscales across four goal areas. 
Included in this factor are the Goal I image in school settings. Goal IV attitude toward school 
and interest in learning. Goal IX valuing and receiving and Goal X effective solution subscales. 
All of these scales relate to attitudes and behaviors associated with classroom or school-related 
settings. 

It appem from the way these subscales cluster that this factor might represent a belief 
that the classroom, school and general community are all fertile grounds to engage in learning 
experiences. 

FACTOR SEVEN: EMOTIONAL ADJUSTMENT TO CHANGE 

This factor is defined by two subscales in the Goal X coping with change instrument. 
The length of time necessary to adjust emotionally to frustration is seen to be strongly associated 
with the tendency to refrain from aggressive or withdrawal reactions to frustrating events, A 
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vicious circle might be reflected here in that people who get wry upset in the face of change 
might be more willing to try negative solutions to their personal problems, leading to a new 
problem and, hence, a continuation of anxiety. 

FACTOR EIGHT: PERSONAL AND EMOTIONAL HEALTH 

This factor is basically defined by the Goal VI health, drug and safety subscales .ogether 
with the effective and ineffective solution subscales of Goal X. AH five of these subscal^ nlate 
to studimt willingness to take various actions in social settings whidi relate to their physical 
or mental well-being. Interpretation of this factor suggests that people who are less able to cope 
with frustration tend to take greater risks in areas of safety, health and drug areas. 

TaWes 7 and 8 present additional statistic resulting from factor analytic procedures. 
The proportion of variation within eaclj subscale that can be accounted for by the eight factor 
solution is shown in Table 7. The explained variation ranges from .54 for the religion subscale 
to a high of .87 for the emotional adjustment subscale. The Fiercent of Trace column in Table 
8 shows what proportion of variability in student scores in the entire test battery can be explained 
by each of the eight factors. 
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SCHOOL 


9. 27? 


PHEALTH 


17- 


14 


WELFDIG 


476 


PHEALTH 


17- 


15 


LAWAUTH 


0. 531 


PHEALTH 


17- 


16 


RESPINTG 


0* 135 


SAFETY 


18- 


1 


GSCLF 


0. 121 


SAFETY 


18- 


2 


CONTE NV 


0* 27 8 


SAFETY 


18- 


3 


RELATE 


0.0"*" 


SAFETY 


18- 




SCHLIHAG 


0. m 


SAFETY 


18- 


5 


R AC £6 2 


3. 137 


SAFETY 


18- 


6 


RFLI6 


0.041 


SAFETY 


18- 


7 


SES 


a. 115 


SAFETY 


18- 


8 


INTELL 


3. 189 


SAFETY 


18- 


9 


H ANOCP 


0. 225 


SAFETY 


18- 


10 


60AL-3V 


0. 161 


SAFETY 


18- 


11 


6 OA L-3H 


0. 137 


SAFETY 


18- 


12 


LEARN 


0. 330 


SAFETY 


18- 


13 


SCHOOL 


0. 34 3 


SAFETY 


18- 


1(» 


WELFDIG 


0.434 



GRADE 8 <<1974>> 





PAIR 






R 


X 






Y 




SAFETY 


18- 


15 


LAWAUTH 


0. 548 


SAFETY 


18- 


16 


RESPINTG 


0.409 


SAFETY 


18- 


17 


PHEALTH 


0.499 


DRUGS 


19- 


1 


6SELF 


0.209 


DRUGS 


19- 


2 


CONTENV 


0.337 


DRUGS 


19- 


3 


RELATE 


0.041 


DRUGS 


19- 


4 


SCHLIMAG 


0.268 


DRUGS 


19- 


5 


RACEG? 


0.118 


DRUGS 


19- 


6 


RELIG 


0*038 


DRUGS 


19- 


7 


SES 


0. 132 


DRUGS 


19- 


8 


INTELL 


0. 134 


DRUGS 


19- 


9 


HANDCP 


0« 194 


DRUGS 


19- 


10 


G OA L- 3V 


a* 323 


DRUGS 


19- 


11 


60AL-3H 


0*313 


DRUGS 


19- 


12 


LEARN 


0* 347 


DRUGS 


19- 


13 


SCHOOL 


0. 393 


DRUGS 


19- 


14 


WELFDIG 


0* 331 


DRUGS 


19- 


15 


LAWAUTH 


0. 472 


DRUGS 


19- 


16 


RESPINTG 


0.343 


DRUGS 


19- 


17 


PHEALTH 


0. 478 


DRUGS 


19- 


18 


SAFETY 


0.572 


VISLART 


20- 


1 


GSELF 


0.04 3 


VISLART 


*5 n ^ 


2 


CONTENV 


0. 039 


VISLART 


20- 


3 


RELATE 


0. 106 


VISLART 


2C- 


4 


SCHLIHAG 


0* 136 


VISLART 


2C- 


5 


RACE62 


0* 114 


VISLART 


20- 


6 


RELIG 


n* 101 


VISLART 


2r- 


7 


srs 


0* 061 


VISLART 


20- 


8 


INTELL 


0*099 


VISLART 


2C- 


9 


HANDCP 


0* 116 


VISLART 


2C- 


IC 


60AL-3V 


-0*059 


VISLART 


2C- 


11 


G0AL-3M 


-0* 065 


VISLART 


20- 


12 


LEARN 


0* 175 


VISLART 


20- 


13 


SCHOOL 


0.120 


VISLART 


2C- 


14 


WELFDIG 


0.08 5 


VISLART 


20- 


15 


LAWAUTH 


0*089 


VISLART 


2C- 


16 


RESPINTG 


0.119 


VISLART 


20- 


17 


PHEALTH 


0.029 


VISLART 


rc- 


18 


SAFETY 


n* 02 5 


VISLART 


20- 


19 


DRUGS 


-0.049 


PERFMART 


21- 


1 


GSELF 


0.032 


PERFMART 


21- 


2 


CONTENV 


-0. 044 


PERFMART 


21- 


3 


RELATE 


0. 120 


PERFMART 


21- 


4 


SCHLIMAG 


0.082 


PERFMART 


21- 


5 


RACEG2 


0. 072 


PERFMART 


21- 


6 


RELIG 


0* 084 


PERFMART 


21- 


7 


SES 


0* 053 


PERFMART 


21- 


8 


INTELL 


0* 089 


PERFMART 


21- 


9 


HANDCP 


0*08 3 


PERFMART 


21- 


10 


GOAL- 3V 


-0. 14? 



ERIC 



5& 

63 



INDIVICI'AL STUPrNT DATA • 





PAIR 






R 








Y 




PtRFMART 


21- 


11 


6CA L-3M 


139 


PlRFMART 


21- 


12 


LFARN 


n« 099 


PERFMART 


21- 


13 


SCHOOU 


'3.C21 


PZRFMART 


21- 


!<♦ 


WELFOIG 


0. 3«*1 


PERFMART 


21- 


15 


L AW AUTH 


a* QtiH 


PERPMART 


21- 


16 


RESPINT6 


C* Q68 


PERFMART 


21- 


17 


PHE ALTH 


0D<» 


PCRFMART 


21- 


IS 


SAFETY 


-n, 028 


PERFMART 


21- 


19 


DRUGS 


-0.115 


PERFMART 


21- 


20 


VISLART 


0. 671 


SCIENCE 


*^ 


1 


G SE LF 


0.037 


SCIENCE 


22- 




CONTENV 


-0. 014 


SCIENCE 


22- 


3 


RELATE 


n. 103 


SCIENCE 


ito ft* 


4 


SCHLIHA6 


a. 07 7 


SCIENCE 


22- 


5 


R AC EG 2 


n, C8R 


SCIENCE 


22- 


£ 


RfLlG 


07 s 


SCIENCE 


22- 


7 


SFC 


092 


SCIENCE 


22- 


3 


INTELL 


0. 117 


SCIENCE 


22- 


9 


H ANOCP 


a. 12C 


SCIENCE 




13 


G OA L- 7V 


-0.C74 


SCIENCE 


22- 


11 


GOA L-3M 


-0. oae 


SCIENCE 


22- 


12 


LEARN 




SCIENCE 


*^ — . 


13 


SCHOOL 


0. 261 


SCIENCE 




If* 


WELFOIG 


3* 


SCIENCE 


22- 


15 


LAW AUTH 


2. J61 


SCIENCE 


22- 


16 


RE3PINT3 


2. 03C 


SCIENCE 


22- 


17 


PHE ALTH 


2.02 9 


SCIENCE 


22- 


18 


SAFETY 


2. 31«=: 


SCIENCE 


22- 


19 


DPUGS 


-0.C5C 


SCIENCE 


22- 


20 


VISLART 


0. £«*7 


SCIENCE 




21 


PERFMART 


664 


WRITING 


23- 


1 


6SE LF 


0.070 


WRITING 


23- 


"> 

lU 


CCNTENV 


-D.05C 


WRITING 


23- 


3 


RELATE 


0. 072 


WRITING 


23- 


(( 


SCHLIHAG 


0.098 


WRITING 


23- 


5 


R AC EG 2 


0. 227 


WRITING 


23- 


5 


RFLI6 


0. 053 


WRITING 


23- 


7 


SES 


0. 024 


WRITING 


23- 


8 


INTELL 


0.076 


WRITING 


23- 


9 


H ANDCP 


0.C40 


WRITING 


23- 


IQ 


G CA L- 3V 


-0. 115 


WRITING 


23- 


11 


G CA L- 3M 


-0. 114 


WRITING 


23- 


12 


LEARN 


0. 109 


WRITING 


22- 


13 


SCHOOL 


0. 021 


WRITING 


23- 


11* 


WELFOIG 


0.024 


WRITING 


23- 


15 


LAW AUTH 


2.026 


WRITING 


23- 


16 


RESPINT6 


0. 019 


WRITING 


23- 


17 


PHE ALTH 


0.016 


WRITING 


23- 


Ifl 


SAFETY 


-0.056 


WRITING 


23- 


19 


DRUGS 


-0. DS5 



• CRAOE 8 ♦♦• <<1974>> 





P AjlK 






R 


X 






Y 




WRITING 




20 


VISLART 


n.56C 


WRITING 




21 


PERFMART 


0.614 


WRITING 


^ ^ ^ 
^ .> — 


22 


SCIENCE 


0. 661 


GOAL-BK 


24- 


1 


GSE LF 


0.130 


G0AL-8K 


24- 


2 


CONTENV 


■0.312 


G0AL-8K 


24- 


3 


RELATE 


n. 1C6 


60AL-8K 


24- 


4 


SCHLIMA6 


n.20E 


60AL-8K 


24- 


5 


R AC EG 2 


0.146 


60AL-8K 


24- 


5 


RELIG 


0.166 


60AL-8K 


24- 


7 


SES 


O.IOC 


60AL-8K 


24- 


8 


INTELL 


0.036 


60AL-8K 


24- 


9 


HANDCP 


C.131 


60AL-8K 


24- 


10 


C OA L- 3V 


0.643 


G0AL-8K 


24- 


11 


GOA L-3M 


0.581 


G0AL-8K 


24- 


12 


LEARN 


0.153 


C0AL-3K 


24- 


13 


SCHOOL 


0.21C 


60AL-8K 


24- 


14 


WELFDIG 


0.182 


G0AL-8K 


24- 


15 


LAW AUTH 


0.072 


60AL-8K 


24- 


16 


RFSPINTG 


0.089 


60AL-8K 


24- 


17 


PHE ALTH 


0.144 


G0AL-8K 


24- 


18 


SAFETY 


Q.143 


G0AL-3K 


24- 


19 


DRUGS 


0.3C7 


G0AL-8K 


24- 


20 


VISLART 


-o.o7r 


60AL-8K 


24- 


21 


PERFMART 


-0. 16? 


GOAL-SK 


24- 


22 


SCIENCE 


-0. 097 


60AL-aK 


24- 


23 


WRITING 


-0. 12 3 


VALUING 




1 


GSELF 


C. 167 


VALUING 


25- 


2 


CONTENV 


0.392 


VALUING 


25- 


3 


RELATE 


0.139 


VALUING 


25- 


4 


SCHLIMA6 


0.303 


VALUING 


25- 


5 


RACEG2 


0.249 


VALUING 


25- 


o 


RELIG 


0.221 


VALUING 


25- 


7 


SES 


0.24 9 


VALUING 


25- 


8 


INTELL 


f7.2C7 


VALUING 


25- 


9 


HANDCP 


0.28 5 


VALUING 


25- 


XC 


G OA L- 3V 


0.358 


VALUING 


25- 


11 


G0AL-3M 


0^33 3 


VALUING 


25- 


12 


LEARN 


0,*41D 


VALUING 


25- 


13 


SCHOOL 


0.435 


VALUING 


25- 


14 


WELFDIG 


0.341 


VALUING 


25- 


15 


LAW AUTH 


0.26 4 


VALUING 


25- 


16 


RFSPINTG 


0. 309 


VALUING 


25- 


17 


PHE ALTH 


0.254 


VALUING 


25- 


IS 


SAFETY 


0.281 


VALUING 


25- 


19 


DRUGS 


0.329 


VALUING 


25- 


20 


VISLART 


0.052 


VALUING 


25- 


21 


PERFMART 


-0.031 


VALUING 


25- 


22 


SCIENCE 


0.216 


VALUING 


25- 


23 


WRITING 


-0.038 


VALUING 


25- 


24 


G0AL-8K 


0.369 



ERIC 



64 



BEST COPT AVMueie 



INDIVIDUAL STUDfNT DATA • 





P ATP 








X 






Y 




R£C£IVNC 


26- 


1 


6 SELF 


0* 12 C 


RECCIVNG 


26- 


2 


CONTE NV 


0* 231 


RECCIVNG 


25- 


3 


RELATE 


0* 103 


ReCEIVNG 


26- 


(» 


SCHLIMAG 


0« 270 


RECEIVNG 


26- 


5 


RACEG2 


0. 21 U 


RECEIVNG 


26- 


6 


RELI6 


0. 180 


RECEIVNG 


26- 


7 


SES 


0. 231 


RECEIVNG 


26- 


8 


XNTELL 


5. 27 8 


RECEIVNG 


26- 


9 


H ANOCP 


n. 304 


RECEIVNG 


26- 


10 


6 OA L- 3V 


n. 102 


RECEIVNG 


26- 


XI 


G0AL-3M 


0. 039 


RECEIVNG 


26- 


12 


LEARN 


0.4S9 


RECEIVNG 


26- 


13 


SCHOOL 


0* 413 


RECEIVNG 


26- 


1<» 


WELFOIG 


0. 319 


RECEIVNG 


26- 


15 


LAWAUTK 


0. 321 


RECEIVNG 


26- 


16 


RESPINTG 


3. 382 


RECEIVNG 


26- 


17 


PHEALTH 


0. 24 8 


RECEIVNG 


26- 


13 


SAFETY 


□•24 7 


RECEIVNG 


26- 


19 


DRUGS 


0.213 


RECEIVNG 


26- 


2C 


VISLART 


3. 237 


RECEIVNG 


26- 


21 


PERFMART 


0. 13 2 


RECEIVNG 


26- 


22 


SCIENCE 


0* 217 


RECEIVNG 


26- 


23 


WRITING 


n. 173 


RECEIVNG 


26- 


2'» 


GOA L-8K 


3. 119 


RECEIVNG 


26- 


25 


VALUING 


0.513 


EFFSOLN 


27- 


1 


GSELF 


n. 137 


EFFSOUN 


27- 


2 


CCNTENV 


0.253 


EFFSOLN 


27- 


3 


RELATE 


n. 38? 


EFFSOLN 


27- 


(» 


SCHLIMAG 


0. 24 9 


EFFSOLN 


27- 


5 


RACE6? 


c.osf: 


EFFSOLN 


27- 


6 


RELIG 


n«024 


EFFSOLN 


27- 


7 


SES 


117 


EFFSOLN 


27- 


8 


INTELL 


0. 174 


EFFSOLN 


27- 


9 


H ANOCP 


0.137 


EFFSOLN 


27- 


10 


6 OA L- 3V 


0. 062 


EFFSOLN 


27- 


11 


0 OA L- 3H 


0. 060 


EFFSOLN 


27- 


12 


LEARN 


0.454 


EFFSOLN 


27- 


13 


SCHOOL 


0. 396 


EFFSOLN 


27- 


l*k 


WELFOIG 


0. 276 


EFFSOLN 


27- 


15 


LAWAUTH 


0. 370 


EFFSOLN 


27- 


16 


RESPINT6 


0. 327 


EFFSOLN 


27- 


17 


PHEALTH 


0. 314 


EFFSOLN 


27- 


18 


S AFETY 


0. 299 


EFFSOLN 


27- 


19 


DRUGS 


0. 290 


EFFSOLN 


27- 


20 


VISLART 


C. 09 8 


EFFSOLN 


27- 


21 


PERFMART 


0.034 


EFFSOLN 


27- 


22 


SCIENCE 


0.057 


EFFSOLN 


27- 


23 


WRITING 


0. 039 


EFFSOLN 


27- 


24 


GOA L-8K 


0. 101 


EFFSOLN 


27- 


25 


VALUING 


0. 267 



• GRADE 8 <<1974>> 





D A TD 






K 


X 






Y 




EFFSOLN 


27- 


26 


RECEIVNG 


C. 319 


INEFFSOL 


28- 


1 


GSELF 


0.259 


INEFFSOL 


28- 




CONTENV 


0. 39 7 


INEFFSOL 


28- 


3 


RELATE 


0.129 


INEFFSOL 


28- 


4 


SCHLIMAG 


0.314 


INEFFSOL 


28- 


5 


RACEG2 


n. 13? 


INEFFSOL 


28- 


6 


RFLI6 


0.12 ft 


INEFFSOL 


28- 


7 


SES 


0.216 


INEFFSOL 


28- 


8 


INTELL 


0.198 


INEFFSOL 


28- 


9 


HANDCP 


0.258 


INEFFSOL 


28- 


10 


G0AL-3V 


0. 231 


INEFFSOL 


28- 


11 


60AL-3N 


0. 171 


INEFFSOL 


28- 


12 


LEARN 


3.374 


INEFFSOL 


28- 


13 


SCHOOL 


0.446 


INEFFSOL 


28- 


14 


WELFOIG 


0.352 


INEFFSOL 


28- 


15 


LAWAUTH 


0. 384 


INEFFSOL 


28- 


16 


RESPINTG 


0. 379 


INEFFSOL 


28- 


17 


PHEALTH 


0. 349 


INEFFSOL 


28- 


18 


SAFETY 


0. 44 8 


INEFFSOL 


28- 


19 


DRUGS 


0. 446 


INEFFSOL 


28- 


20 


VISLART 


0. 028 


INEFFSOL 


20- 


21 


PERFMART 


-0.031 


INEFFSOL 


28- 


22 


SCIENCE 


-0. 001 


INEFFSOL 


28- 


23 


WRITING 


-0. 058 


INErFSOL 


28- 


24 


6 0AL-8K 


0. 189 


INEFFSOL 


28- 


25 


VALUING 


0. 350 


INEFFSOL 


28- 


26 


RECEIVNG 


0.28 5 


INEFFSOL 


28- 


27 


EFFSOLN 


0. 366 


'^MOTADJ 


29- 


1 


GSELF 


0. 155 


EMOTADJ 


29- 


2 


CONTENV 


0* 136 


EHOTADJ 


29- 


3 


RELATE 


0.064 


EMOTADJ 


29- 


4 


SCHLIMAG 


0. 117 


EMOTADJ 


29- 


5 


RACE62 


0. 110 


EMOTADJ 


29- 


6 


RELIG 


0. 104 


EMOTADJ 


29- 


7 


SES 


0.090 


EMOTADJ 


29- 


8 


INTELL 


3.084 


EMOTADJ 


29- 


9 


HANDCP 


0.03 8 


EMOTADJ 


29- 


10 


G0AL-3V 


3-056 


EMOTADJ 


29- 


11 


60AL-3H 


0.043 


EMOTADJ 


29- 


12 


LEARN 


0.0S7 


EMOTADJ 


29- 


13 


SCHOOL 


0.097 


EMOTADJ 


29- 


14 


WELFOIG 


0.097 


EMOTADJ 


29- 


15 


LAWAUTH 


0.08C 


EMOTADJ 


29- 


16 


RESPINTG 


0. 083 


EMOTADJ 


29- 


17 


PHEALTH 


0.135 


EMOTADJ 


29- 


18 


SAFETY 


Q. 122 


EMOTADJ 


29- 


19 


DRUGS 


0. 121 


EMOTADJ 


29- 


2C 


VISLART 


-0.030 


EMOTADJ 


29- 


21 


PERFMART 


-0.02 5 


EMOTADJ 


29- 


22 


SCIENCE 


-3.012 



ERIC 



60 

65 



XNOIVZDUAL STUOfNT DATA GRAOET 8 <<X974>> 



PAIR 



EMOTADJ 29- 23 WRITING OmQUl 

EHOTAOJ 29- 2«l 60AL-8K 0.059 

EMOTAOJ 29- 25 VALUING 0.051 

EMOTADJ 29- 26 RECEIVN6 0.028 

EMOTADJ 29- 27 EFFSOLN -0.018 

EMOTADJ 29- 23 INEFFSOL 0.t»06 



ERIC 



61 

66 
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^^"^^ BEST WW AVMIABU 

VARZMAX ROTATION 
INDIVIDUAL STUDENT DATA GRADE 8 <<1974>> 



ROTATION OF FIRST 8 FACTORS 



CONMUNAUITieS 



GSELF 


1 


C,75325 


LAUAUTH 


15 


0.77295 


CONTCNV 


2 


C .59120 


RESPINT6 


IE 


0.75699 


RELATE 


3 


C .70286 


PHEALTH 


17 


0.576(»1 


SCHL7HA6 




C.&1943 


SAFETY 


18 


0.65007 


KACCG2 


5 


c.eiixx 


DRUGS 


19 


0.68555 


RELIG 


5 


n.S<»738 


VISLART 


20 


0.71151 


SES 


7 


C.65X3Q 


PCRFMART 


21 


0.75158 


INTELL 


8 


C.6(»378 


SCIENCE 


22 


0.76769 


HANOCP 


9 


0.E7(l3X 


WRITING 


23 


0.70112 


G0AL-3V 


IC 


G.7857C 


eOAL*8K 


2*1 


0.69173 


0 0AL-3H 


11 


0.73730 


VALUING 


25 


0.59X78 


LEARN 


12 


C. 70538 


RFCEIVNG 


26 


0.6C679 


SCHOOL 


13 


C.688(IC 


EFF50LN 


27 


C.53«»95 


WELFDIG 


If* 


C. 73912 


INEFFSOL 


28 


0.69%6<l 








EKOTADJ 


29 


0.87793 



TABLES 

SUM OF SQUARED ROTATED FACTOR LOADINGS 

SUM FOR PERCENT 

EACH COLUMN OF TRACE 

FACTOR 1 2.22S5 11.12 

FACTOR 2 2.9777 13'.27 

FACTOR 3 2.4S40 8.f»6 

FACTOR <» 2.9833 1C.29 

FACTOR 5 2.6'»2<» 9.11 

FACTOR e 2.9307 lO.XX 

FACTOR 7 X.3167 <l.54 

FACTOR 8 1.3720 4.59 



ERIC 



The Pennsylvania Education Quality Assessment Inventory's efficiency in generating an 
accurate profile of studentbody needs hinges on the ability of people to communicate with people 
throu^ the medium of paper^d-pendl tests. Evidence supiH^rting this notion has been obtained 
through a long series of studies conducted by Department of Education personnel with the help 
of administrators, teachers and students in over 40 per cent of Pennsylvania's local school districts. 
Fmdings support generalizations that: 

Students can read and understand the questions in the battery 

Students tend to answer the questions in such a way as to 
reflect their true feelings 

Studentf^ answer similar items in a consistent manner 

Students tend to answer items in similar ways across time 

Student classroom behaviors are mirrored by student test scores 

Students generally feel the tests are worthwhile and the vast 
majority take the tests seriously 
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TEvget Groups 
for 

Program Focus 
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ORGANIZING INFpRM ATION TO IDENTIFY STUDENT TARGET GROUPS 



Ideally, when pi\;pahng to initiate a program to facilitate student progress in any goal 
area, one should be able to identify students most Ukely to benefit from that program. However, 
information available to •schools participating in Pennsylvania's Educational Quality Assessment 
Program does not contain data on individual students. Consequently, it is impossible for school 
personnel to identify by name the members of the target group toward whom a program might 
be focused. 

Even though individual profiles are unavailable, it is possible to organize data in ways 
that help identify general student groups that demonstrate needs in a given goal area. This is 
done by summarizing data for various subgroups of students formed from selected student 
characteristics. The characteristics defining the subgroups are achievement level, sex and father's 
occupational status. 

Student ability is categorized into three levels on the basis of the composite math-verbal 
achievement score. Students scoring below the 30th percentile are defined as the low ability group. 
Students scoring between the 30th and 70th percentile are placed in the middle ability group. 
Those exceeding the 70th percentile are defined as the hi^ ability group. 

Students are also assigned to three groups on the basis of their father's or legal guardian's 
reported occupation. These occupation categories are labeled for convenience as ^miskilled, skilled 
and professional. These categories are abstractions based upon the average educational requirements 
necessary to obtain the job and the average amount of compensation for the particular occupations. 
It is recognized here that there are exceptions in any or all of these categories. The semiskilled 
occupational category includes hospital attendant laborer, operator of industrial equipment, packer, 
wrapper, miner, quarry worker, painter, roofer, paper hanger, carpet layer, truck driver, taxi driver, 
service station attendant, watchman, barber, waiter, cook, farmer and carpenter. 

The skilled occupational category included cabinetmaker, dental technician, nurse, 
librarian, foreman, toolmakcr, machinist, electrician, plumber, bricklayer, stonemason, heavy 
equipment operator, mail carrier, telephone operator, printer, decorator, policeman, firefighter, 
repairman, butcher, mechanic, tailor, forester, secretary, clerk, office worker, salesperson, grocer 
and minister. 

The professional occupational category includes dentist, doctor, veterinarian, architect, 
pilot, teacher, school administrator, editor, farm agent, stockbroker, insurance agent, real estate 
agent, personnel manager, bank official, lawyer, judge, engineer, social scientist and natural 
scientist. 

Eighteen groups are formed by taking all possible combinations of the three student 
characteristics. The proportion of students who responded favorably to more than one-half of 
the items comprising each scale are presented in Table 9. 
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TABLE 9 



PER CENT OF STUDENTS SHOWING POSITIVE ATTTTUDE: 

BY GOAL AREA 



TYPE OF STUDENTS 



Low ability 


Semiskilled fathers 


MqIm 


Low ability 


Semiskilled fathers 


Petri At ^ 


Low ability 


Skilled fathers 


Malen 


Low ability 


Skilled fathers 


Pa t%% alAo 
rvInaivS 


Low ability 


PmfeceiiMiAl fsithi*re 
t Ivlvskaivilcu ittiiido 




Low ability 


Prnfe^cdftnal fdtherR 




Middle abilitv 


Semiskilled fathers 




Middle abilitv 


Semiskilled fatheix 


Pa fffi al Afi 


Middle ability 


Skilled fathprfi 




Middle ability 


Skilled fathers 


Pa mat AC 


Middle ability 


Professional fathers 


Males 


Middle ability 


Professional fathens 


Females 


High ability 


Semiskilled fathers 


Males 


High ability 


Semiskilled fathers 


Females 


High ability 


Skilled fathers 


Males 


High ability 


Professional fathers 


Males 


High ability 


Professional fathers 


Females 



Average per cent showing positive attitudes 



Geariy, in today's world, women are playing an increasingly important role in defining the 
occupational level of the fainily. However, data were unavailable to reflect this trenr* Therefore, 
we are forced to use the father's occupational level as a proxy for the socioeconomic conditions 
of the home. 
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TABL£9(con*t.) 
PER CENT OF STUDENTS SHOWING POSITIVE ATTITUDE: 

BY GOAL AREA 



GOAL NUMBER I II IV V VI VO-A VI14» IX X 



70 60 


52 


11 


23 


61 


28 


28 


70 


66 68 


62 


19 


28 


63 


17 


38 


72 


69 64 


55 


10 

ft V 


20 


68 


30 


31 

ft 


64 


70 68 


65 


20 


35 


70 


20 


41 


74 


69 72 


61 

w ft 


18 

ft 0 


29 


70 


30 


33 


68 


77 68 


6S 


27 


33 


63 


22 


43 


75 


R4 66 


61 


17 

ft r 


33 


60 


17 

ft r 


32 


76 


78 83 


68 


34 


45 


64 


13 

ft 


48 


74 


82 67 


62 


26 


38 


56 


13 

ft *^ 


41 

^ ft 


75 


79 79 


66 


39 


47 


63 


12 

ft 4V 


46 


79 


86 70 


57 


20 


35 


57 


15 

ft w 


42 


77 


75 81 


75 


36 


41 


67 


17 


54 


79 


82 68 


73 


28 


55 


53 


15 


43 


79 


86 89 


85 


54 


59 


64 


19 


62 


82 


88 71 


72 


24 


50 


62 


12 


52 


77 


83 81 


79 


42 


51 


66 


13 


55 


79 


89 72 


79 


25 


52 


62 


16 


58 


79 


91 93 


83 


45 


53 


73 


25 


72 


84 


79% 72% 


67% 


26% 


40% 


63% 


18% 


45% 


75% 



Note: Student percent^i^ based on random sample of 3,459 8th grade students. 
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